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Preface 



Networks of queues ( = stochastic networks) have been a field of intensive re- 
search over the last three decades. The foundation for this research is classical 
queueing theory, which mainly dealt with single node queueing systems [21], [24], 
[49] . There is now a well developed theory of stochastic networks accompanied 
by an unbounded set of open problems which originates directly from applica- 
tions as well as from theoretical considerations. Most of these open problems 
are easily stated and put into a theoretical framework, but often require either 
intricate techniques on an adhoc basis or deep mathematical methods. Often 
both of these approaches have to be combined to successfully tackle the solution 
of a quickly formulated problem. 

The possibly most infiuential sources were the books by Kelly [75], Whittle 
[139], and Walrand [136]. The recent books by Van Dijk [40], Serfozo [121], and 
Chao, Miyazawa, Pinedo [18] gave a good state-of-the-art survey of the subject. 

The development of queueing network theory which provided application 
areas with solutions, formulas, and algorithms commenced around 1950 in the 
area of Operations Research, with special emphasis on production, inventory, 
and transportation. The first breakthrough came with the works of Jackson [69] 
and Gordon and Newell [50]. Both papers appeared in Operations Research. 
The second breakthrough in queueing network theory was already connected 
with Computer Science: the celebrated papers by Baskett, Chandy, Muntz, and 
Palacios [4], which appeared in the Journal of the Association for Com- 
puting Machinery, and by Kelly [74]. 

At the same time the two volumes of Kleinrock’s book appeared [81], [82]. From 
that time on queueing network theory and its application has been intimately 
connected with performance analysis of complex systems in Computer and Com- 
munication Sciences, both on the hardware and on the software level. 

The way that production, manufacturing, and transportation is growing to- 
gether with information processing and communication technology is resulting 
in more and more complex systems which require even more elaborate models, 
techniques, and algorithms to better understand their performance behavior and 
to predict performance and quality of service. 

The classical single node queues and their networks are models living on a 
continuous time scale. Even if for some applications a discrete time scale might 
be more appropriate, the well established continuous time machinery often ser- 
ves as an approximation tool. Consequently, the survey articles [24], [137] from 
1990 still do not review discrete time models. 

However, from then on an astonishing evolution of discrete time stochastic 
network models can be observed. Usually it is thought that the invention of 
ATM (Asynchronous Transfer Mode) as the protocol for high speed transmission 
network technology triggered this development. 
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At least three (to my knowledge) books appeared recently solely dedicated 
to theory and applications of discrete time queueing systems and networks, [14], 
[128], and [142]. The contents of this lecture notes are spread over the same area, 
but are almost complementary to the above mentioned books. The center of my 
interest is the question, whether there is in discrete time an analogue to the 
celebrated product form calculus of continuous time stochastic network theory. 
This calculus lies behind the two breakthroughs mentioned above. Its simplicity 
and general applicability was its entrance ticket into applications. Its theoreti- 
cal elegance opened the door to mathematical investigations around stochastic 
networks. 

From a mathematical point of view, for the description of stochastic net- 
works, we deal with stochastic processes in continuous time as well as in discrete 
time. The theory of stochastic processes in continuous time is much more ela- 
borate than that in discrete time. However, we shall see that we have to pay for 
turning to the simpler theoretical framework by being burdened with a much 
more technically involved machinery for arriving at simple methods for perfor- 
mance analysis and simple algorithms. The question of whether there can be a 
product form calculus in discrete time will be answered moderately positively 
in the book, but in my opinion the answer is still in a premature status. There 
seems to be much need for further research and there are disappointing negative 
partial answers in cases where the continuous time counterparts of the question 
have an easy positive answer. This will be discussed at several instances throug- 
hout the presentation. 

The text is centered around explicit expressions for the steady state behavior 
of discrete time queueing networks. Three classes of networks which show a 
product form equilibrium will be discussed in detail: 

(1) Linear networks (closed cycles and open tandems) of single server FCFS 
Bernoulli nodes. 

(2) Networks of doubly stochastic and geometrical queues (which are di- 
screte time analogues of Kelly’s symmetric and general servers and of the BCMP 
nodes): 

Customers of different types move through the network governed by a general 
routing mechanism. Request for service at symmetric servers may be according 
to general distributions. 

(3) Networks with batch movements of customers and batch service. The 
service and routing mechanism is defined on the basis of an abstract transition 
scheme. 

I further discuss computational algorithms for the standard performance 
measures and present explicit results on end-to-end-delay distributions and 
their moments. 

The mathematical prerequisites for reading the book are moderate: discrete 
time Markov chains and their elementary linear algebra, and elementary trans- 
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form methods (generating functions, z-transform) as can be found in [70], chap- 
ter 2, 3, and [71], chapter 10, 11, or [44], chapter 15, or [66], [67]. Knowledge 
of elementary continuous time queueing networks, [75], [47] would be helpful to 
understand their discrete time counterparts, but is not necessary. 

I tried to compile the relevant literature with respect to discrete time sto- 
chastic networks. But, unfortunately enough, due to the enormous increase of 
publication rates in the field I am quite sure that I have missed some sources. 
However, I did not try to repeat the compilation in [18] on batch movement 
networks (with e.g. signals and further specific properties) where in general it is 
proposed, that the derivations and results hold for discrete time and continuous 
time systems equally. A number of models, which in my opinion are prototype 
models, are surveyed in chapter 6 with reference to further readings. 

These lecture notes are based on the lecture notes of a one-semester course 
on “Discrete Time Stochastic Networks” held at the Department of Mathema- 
tics at Hamburg University in summer 1997 for students on a graduate level. 
The audience consisted of members of the Departments of Mathematics and 
Computer Sciences and of the Department of Communication Networks of the 
Technical University of Hamburg-Harburg. A preliminary version of these lec- 
ture notes was used as material and distributed within a Tutorial on “Discrete 
Time Queueing Networks: Recent Developments”, which I held at the conference 
Performance ’96 in Lausanne (Switzerland) in October 1996. 

The text is a report on some parts of the recent research and development 
in stochastic network theory and some of its applications. It may also serve as 
a textbook for a course on discrete time stochastic networks or as a companion 
book in a course on (elementary) stochastic processes. 

Acknowledgements. I would like to thank students and colleagues who par- 
ticipated in the lectures on “Discrete Time Stochastic Networks” in summer 
1997 for their many valuable comments and remarks on the problems I presen- 
ted to them. I thank Kristin Betancourt for reading parts of the manuscript. I 
am grateful to Regina, Mirok Korea, and their friends for their encouragement 
and continuous support during the time I was writing these lecture notes. 



March 2001 



Hans Daduna 
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Introduction 



1.1 Introduction 

The standard models of classical queueing theory are systems operating in con- 
tinuous time. Applying such queueing models to predict the performance of 
transmission channels dates back to the early times of Erlang around 1925 (see 
[12]). Generalizations of his famous Erlang’s formulas for loss and waiting pro- 
babilities are still of practical value in performance analysis. Even more: With 
the advent of modern high speed transmission networks much more elaborated 
techniques are developed to predict for these networks such probabilities which 
count as important characteristics for their quality of service. 

In the early times of queueing theoretical applications in telecommunication sy- 
stems networks of transmission lines were modeled using brute force decomposi- 
tion approximations - which are still in use and are considered as unavoidable in 
many situations. Short descriptions are [47], chapter 5 for the continuous time 
framework, [14], section 4.1.6 for discrete time networks. 

First steps to overcome the restriction to decomposition approximations were 
done around 1950 by coupling classical exponential queues in lines. These were 
used to model jobshop like production systems, transportation lines, and com- 
plex distribution lines with inventories. Next step was the first breakthrough by 
the works of Jackson [69] and Gordon and Newell [50] as part of Operations Re- 
search. In these networks indistinguishable customer traveled through nodes on 
a network graph, who experienced delay at the service stations due to congestion 
of the nodes, which originates from service requests of other customers. 

For computing systems and their networks Kleinrock popularized queueing 
network theory in continuous time as a powerful tool in performance analysis, 
([79]). Applying the very important and useful independence approximation on 
the behaviour of packets in packet switching networks he recommended to use 
open exponential queueing networks {Jackson networks, [69]) to predict equili- 
brium queue lengths distributions, waiting times, and mean transmission times, 
what is now generally termed quality of service for these systems. 
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A second breakthrough was the invention of network models with different 
customer classes, class dependent random routing, and general transmission time 
distributions for some specific service regimes by Baskett, Chandy, Muntz, and 
Palacios. These networks are now well known as BCMP networks [4]. 

A more versatile class of network models including the BCMP networks was 
introduced at nearly the same time by Kelly [74], for a detailed introduction see 
[75]. Starting from both of these classes of network models a lot of generalizations 
have been introduced providing us with even more detailed modeling tools in 
continuous time, for a more recent survey see [127]. 

In the context of continuous time systems discrete time Markov chains play 
an important role. Defined as embedded chains they provide us with techniques 
to deal with continuous time single servers or even networks when the system 
is observed only at specific time points, e.g., arrival or departure instances. For 
an introduction see Kleinrock’s monograph [81], Volume I, Part III, and for the 
application of these methods in performance analysis of computer and commu- 
nication systems [82], Volume II. 

Another use of discrete time models is to approximate continuous time models 
via time quantization, which especially serves for the numerics of direct compu- 
tations, see e.g. [82], Volume II, Chapter 2.6. 

While these applications of discrete time Markov chains to queueing mo- 
dels are to be considered as construction of auxiliary models for to investigate 
continuous time stochastic networks, another approach (of completely different 
character) to performance analysis of computer and communication systems was 
developed around 1965. This approach was triggered by the introduction of real 
world systems which show an inherent generic slotted time scale. In the field 
of computer science time-shared computing systems are perhaps the most well- 
known and earliest of such systems, investigated with methods from discrete 
time Markov chain theory, [78], [80]. Here the discrete time scale is prescribed 
by the size of the time slot that is given to a job before the processor is dedica- 
ted to the next job - serving jobs in a round-robin regime. A further prominent 
example from the area of communication networks is the slotted ALOHA pro- 
tocol. This protocol is an example for a medium access protocol which governed 
the contention for shared bandwidth by different users in satellite transmission 
networks, see [142], chapter 6, and the references there. 

It turned out that the technical difficulties which arise when working under 
a discrete time scale were in many cases considerably greater than in dealing 
with continuous time models. The reason for this is the combinatorial comple- 
xity which appears in the solution procedures for the global balance equations 
of these systems, [78], [80]. A consequence at that time was to use continuous 
time approximations for the generic discrete time systems, e.g., converting time- 
sharing systems into processor-sharing models. For a first highlight of this suc- 
cessful approach see [114], and for a review with more elaborated applications 
in performance evaluation (e.g.) [82], Volume II, Chapter 4. 

Following this great success of the continuous time theory, discrete time queu- 
eing theory, especially the theory of queueing networks with explicit discrete 
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time scale, seem to lay dormant for about nearly twenty years. But a conti- 
nuous -although thin- stream of papers on the subject appeared over the years: 
For summaries and fundamental questions on the state-of-the-art at that time 
we refer to the lectures of Kobayashi ( in [95]), where applications in time- 
multiplexing transmission systems are described, and the monograph of Hunter 
([66] and [67]), where the fundamental single server queues are elaborated on. 

The recent interest in discrete time queueing models emerged from the intro- 
duction of ATM (Asynchronuous Transfer Mode) as the multiplexing technique 
for Broadband Integrated Services Digital Networks (B-ISDN). For a collection 
of recent studies see [87]. These networks are featuring (at least) three levels with 
different time scales: Call level, burst level, and cell level, where network access 
control may be applied. The latter two levels can be and mostly are modeled 
by discrete time systems: Single switches for the network as well as the whole 
network itself. 

The ATM switches on the cell level are modeled by discrete time queues, because 
these systems are assumed to work synchronously on the basis of a smallest time 
unit. The time scale is prescribed by the time needed to transmit just one cell. 

The renewed interest is expressed by a continuously growing number of fur- 
ther research papers on discrete time queueing systems appearing in journals 
dedicated to the fields of computer science, electrical engineering, operations 
research and mathematics. Only recently there appeared the mentioned three 
books on discrete time queues, [14], [128], and [142] , and special issues of Per- 
formance Evaluation: Discrete time models and analysis methods and Queueing 
Systems and Their Applications: Advances in discrete time queues were dedica- 
ted to the subject. The Editorial Introductions [133], [101] of these issues serve 
to advertise for this class of models as being useful in predicting and explaining 
systems’ behaviour and for being profitable for applications and challenging in 
theory. 

The aim of these lectures notes is not to give an introduction into a general 
discrete time queueing theory, but to highlight some (in my view) important and 
interesting subjects of actual research which at the same time can be viewed as 
being potentially applicable in the fields mentioned above. To a certain extent 
well developed is now the theory of single node systems in discrete time and it 
is impossible to survey the whole literature concerning isolated systems. Single 
node queueing theory in discrete time is well documented because the recent 
books provide us with detailed information [14], [128], [142], and [132], the lat- 
ter with an emphasis on elementary introduction of transform methods. 

There is now available a vast literature on discrete time models for ATM swit- 
ches, see e.g. the books [14] (especially the sections on “Further Readings” there), 
[128], and the recent survey [140]. In-depth studies of single node systems in di- 
screte time with direct applications to modeling ATM systems are [62] and [131]. 

Dealing with single nodes in the first chapter of the book will therefore be 
only introductory for building networks which I shall describe completely and in 
detail. Nevertheless in chapter 2 when generalizing recent results some versatile 
single node models will be presented which seem to be new. 
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The research on queueing networks in discrete time is still in a somewhat pre- 
mature state. Despite the work of Hsu and Burke [65], Walrand [135], Pujolle, 
Claude, and Seret [109], and Schassberger, Daduna [33], [118] in the 1980ies, 
only with the beginning of the 1990ies a continuously active research in the field 
started, searching for general explicit solutions for the performance measures 
of networks. And still up to now general results providing explicit performance 
measures for discrete time queueing networks are rare. An exception is chapter 
12 [18] where a versatile class of models is described which are developed for 
continuous time and discrete time in parallel. Our third topic below is dedicated 
to this (chapter 6). 

In the well-established evaluation methodology of continuous time systems 
the computation of performance measures as indicators of the quality of service 
(equilibrium joint queue length distribution for the nodes, end-to-end-delay for 
messages, throughput, etc.) relies almost always on finding product form equi- 
librium behaviour for the networks. That means: The network’s nodes behave 
in equilibrium as if they are independent, the network is therefore separable. 
On the other hand, for queueing networks with slotted time scale performance 
evaluation up to now is usually done either by simulation, or by using direct 
general numerical procedures, or by applying heuristic approximations, see for 
example [14], chapter 4. Therefore the most challenging problem in my opinion 
is to develop a product form calculus similar to the one in the continuous time 
setting. What we should hope at the time being is finding versatile classes of 
network models which allow explicit computations yielding closed form solutions 
of the main performance indices. And what we shall expect is that there will be 
in the discrete time case a close connection too between explicit formulas for 
performance indices and a certain product form structure of these formulas. The 
latter will then indicate possibly locally balanced behaviour of the networks. 
Some first steps in this direction collected from the literature which may be 
considered as being landmarks in the broad and unexplored field shall be de- 
scribed in this lectures. Their main features will be discussed with respect to 
applications and directions of hopefully fruitful further research. 

In the course of describing these models some generalizations and specifica- 
tions will be presented as well, which widen their applicability in the concrete 
modeling process and may expand the usage of analytical methods in discrete 
time performance analysis. 

The results to be presented can be divided into three groups: 

(1) Linear networks (closed cycles and open tandems) of single server nodes 
under the First-Come-First-Served regime with Bernoulli input stream and 
geometrically distributed service times were investigated by Hsu and Burke [65] , 
Pujolle, Claude, and Seret [109] (1986), Pestien and Ramakrishnan [107], and 
Daduna [26], [29], [28], [31]. We prove in chapters 3, 4 a product form equilibrium 
and compute the distribution of the end-to-end-delay. At present there seem to 
be severe limitations for generalizations of this class of networks. This point will 
be discussed. 
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(2) Networks of doubly stochastic and geometrical queues (which are di- 
screte time analogues of Kelly’s symmetric servers and of standard exponential 
queues): Customers of different types move through the network governed by 
a general routing mechanism and request for service according to distributions 
which depend on their type and the node where they stay. Under a restriction 
on simultaneous movements product form equilibrium is derived and the con- 
ditional expected system time for a customer is computed given his individual 
requests for service at the stages of his itinerary through network. This section 
reports on work done by Schassberger, Kruger, and Daduna, [33], [119], [89]. 

(3) The naturally emerging batch movements of customers and their batch 
service in discrete time stochastic networks suggest to consider these phenomena 
from a more abstract point of view. This has been done in Walrand’s [135] early 
paper, and in a series of recent papers of Henderson, Taylor, Pearce, Northcote, 
Boucherie, van Dijk, Chao, Miyazawa, Pinedo, and others, see e.g.: [55], [60], and 
[98] , [99] . Here the service and routing mechanism is either defined on the basis of 
an abstract transition scheme that generates explicit steady state distributions 
from its very definition, or the customers move nearly independent from one 
another through the system, which yields product form via the independent 
behaviour. 

This research is partially summarized in chapter 12 of [18], and we deal with 
that topic in chapter 6, presenting some selected models. 

There are further directions of research on queueing networks in discrete time 
not dealt with in these lecture notes. Some representatives may be found in the 
following references: 

Morrison [103] considered a two-stage tandem with deterministic service ti- 
mes and interfering Bernoulli arrival processes. This was generalized by Boxma 
and Resing [11] to more general arrivals into an n-stage tandem. The results 
reported are mainly by means of transform methods. 

To consider service systems with deterministic service times of duration of one 
time slot seems to be a natural task in the context of modeling ATM networks. 
This is because the size of the time slot is usually chosen to be the time needed to 
transmit a single cell. Turning to random transmission times follows the need to 
incorporate the load of competing parallel transmissions from different sources 
and the introduction of local traffic control (e.g. leaky bucket) which consumes 
extra time. 

Sharma [124] proved a functional Central Limit Theorem and a functional 
Law of Iterated Logarithm for discrete time stochastic networks with overall 
deterministic-(l) service times and renewal arrivals from the exterior. An over- 
view of Brownian and non-Brownian functional central limit theorems for single 
server discrete time queues is in [138]. 

Kouvatsos, Tabet-Aouel, and Denazis [88] apply maximum entropy principles 
to obtain product form approximations for the steady state probabilities of a 
rather general switching processs in a discrete time model. 

A theoretical treatment related to the systems dealt with in this survey is 
presented by Henderson, Pearce, Taylor, and van Dijk [61] : They developed a 
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discrete time Generalized Semi-Markov formalism similar to that in continuous 
time, [48], [115], [116]. The latter, although originally developed for rather theo- 
retical purposes, is nowadays thought to be the adequate description for Discrete 
Event Dynamic Systems in stochastic simulation procedures. 

Finally I want to stress that the application of the theory to modeling ATM 
networks relates the topics of the lecture notes only to one special class of ap- 
plication. There are numerous other applications, where a discrete time scale is 
essential for the system’s behaviour and its description and understanding - and 
therefore for the modeling process. Some few examples from related fields are: 

Cyclic-reservation protocols for high speed networks [134]. 

Woodward elaborates in his textbook [142] in detail medium access protocols 
for satellite networks (e.g. ALOHA protocols) and local area networks (under 
carrier sensing and token passing protocols) and their modelling by discrete 
time systems. He focusses on the network models invented by Walrand [135], see 
section 6.4. Similar models in a discrete time setting are described by Kobayashi 
[83] in his lecture notes. 

Several discrete time network models for parallel and sequential task proces- 
sing are developed by Hofmann, Muller, and Natarajan [63]. They compared the 
performance of the different processing schemes under different load behaviour. 

General inventory models with deterministic lead times [72]: This suggests 
to use the lead time duration as a time unit. To tackle inventory problems on 
that basis in a similar way with methods described here seems to be promising. 
A completely different approach to use discrete time methods is suggested by 
Tempelmeier [130], [129]: Time unit is the minimal time between two successive 
inventory review points, often exactly one day. This coincides with often having 
exactly one arrival point for orders per day. 

Conveyor and transportation models with equidistant carriers admit a natu- 
ral discrete time scale, see for an evaluation with application to communication 
systems [1]. 

Population models in space and time, where time is scaled by the sequential 
arrivals of successive generations; discrete time compartment models (see [75] 
for the continuous time case). 

A survey of applications of discrete time queueing systems is section 1.1 of 
[14] with a focus on communications systems, dam models, and transportation 
systems. 



1.2 Symbols and Conventions 

For ease of notation throughout the book we fix a common probability space 
(fl,lF,P) and assume all random variables which occur to be defined on (fl,iF,P), 
unless otherwise specified. 

If a probabiliy measure P on (H,P) that governs some stochastic process 
A = ((A„ : (L!,P,P) ^ (E,S)) : n G N) 
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has to be specified further, often for guaranteing that X is stationary with sta- 
tionary distribution ( = steady state = equilibrium) tt, this will be indicated by 
writing An expectation e.g. of A„, with respect to such P„. is written 
Similar expressions will be selfexplaining. 

M denotes the real numbers, My := [0, oo). 

The natural numbers are W := {0, 1,2,...}, the strict positive natural numbers 

are JNy := {1, 2, 3, . . . }, and we denote ^ :={... , —2, —1, 0,1,2, }. 

We denote by 



S(a, b) 



1 if a = b 
0 if tty^b 



the Kronecker delta, and by 



77(0,6) 



1 if o yf 6 
0 if a = b 



the complementary Kronecker delta. 




Chapter 2 

State Dependent Bernoulli 
Servers 



In this section we consider the most elementary queueing system in discrete 
time. It is the analogue of the state dependent exponential single server queue in 
continuous time under First-Come-First-Served (FCFS) regime. We begin with 
systems where all customers are indistinguishable and summarize in section 2.1 
the steady state performance measures. Most of those problems can be interpre- 
ted as special questions about the behaviour of random walks in discrete time. 
This does not hold in case of customers of different types arriving at the service 
node which we consider in section 2.2. In Section 2.3 we reconsider both models 
and allow immediate feedback of departed customers to the server. 



2.1 Indistinguishable Customers 

The time scale for our systems is IN = {0,1,2,...}, sometimes we shall use 
Z = IN U —IN = {. . . , — 2, — 1, 0, 1, 2, . . . }. There is a single service facility 
where at each time instant at most one customer may be served. Customers 
are indistinguishable and arrive one by one randomly at the server. If at the 
arrival instant the server is free the service of the arriving customer immediately 
commences. Otherwise an arriving customer enters the waiting room which is 
organized on a FCFS basis (sometimes called FIFO: First-In-First-Out). If a 
customer has obtained his total service request he departs immediately from the 
system. If a customer departs and there is at least one further customer present 
then the customer at the head of the waiting line enters the server, his service 
commences immediately, and all other waiting customers are shifted one place 
up in the line. The time needed for reorganizing the queue is assumed to be 
neglectible (zero time). 

The system’s development over time will be described by a discrete time 
stochastic process X = {Xt : t G IN) with state space IN. Xt denotes the 
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Bernoulli stream 



FCFS 



geometrical server 



Fig. 2.1. Bernoulli Server 



number of customers present at time t, either in service or waiting, shortly the 
queue length at time t. 

The randomness of the system is due to the following assumptions: 

If at time t a customer is in service and if there are n — 1 > 0 other customers 
present then this service ends in the time segment [t, t+1) with probability p{n) G 
(0, 1) and the customer will depart at the end of this time slot; with probability 
q{n) = 1 — p{n) this customer will stay at least one further time quantum. The 
decision for a customer whether to stay or to leave is made independently of 
anything else other than the queue length at time t. If at time t G IN there are 
n > 0 customers present then at the end of time slot [t, t+ 1) a new customer will 
arrive with probability b(n); with probability c(n) = 1 — 6(n) there will be no 
arrival. The decision whether an arrival will occur or not is made independently 
of anything else other than the queue length at time t. Such an arrival stream 
will be termed henceforth state dependent Bernoulli arrival process. (For some 
special models we shall allow p{n) = 1 and/or b(n) = 1; see e.g. corollary 2.8, 
example 2.9.) 



Arrival At-\ 



Arrival At 



Xt 

\ 



1 



t 



t+1 



Departure Df-i 



Departure Dt 



Fig. 2.2. Regulation of arrivals and departures 



Unless otherwise specified, we shall assume throughout the notes the follo- 
wing rules for the regulation of simultaneous events: All arrivals (and departures) 
occur at the end of the respective time slots {LA-rule; late arrivals). If at the 
same epoch an arrival and a departure occur we always assume that the depar- 
ture event takes place first. {D/A-rule; departure before arrival, see [51].) The 
state of the system is recorded at times t G IN just after possible departures and 
arrivals have happened. (Figure 2.2.) 
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A pathwise analysis of the system considers sequences of successive arrivals 
and departures which result in the queue length process observed at the time 
epochs at slot boundaries t £ IN. 

Definition 2.1 (Departure and arrival process) We denote by 

D = {Dt : t € IN) and A = {At : t £ IN) 

the sequences of numbers of departing, resp., arriving customers in time slot 
[t, t + 1), and assume 

P{Dt+i = k\Xs,Ds,Ag : s < t,Xt+i) = P{Dt+\ = k\Xt^i), t>0, 

and 

P{^t+i = k\Xg, Dg, Ag : s < t, Xt+i, Df+i) = P{At+i = k\Xt+i), t >0 
to hold. 

Corollary 2.2 (Queue length process) The queue length process is pathwise 
defined by 

Xt+i = Xt — Dt + At, t £ IN , Xu prescribed. (2-1) 

X = {Xt : t G IN) is a time homogeneous Markov chain. 

In the literature there is a great variety of arrival and departure regimes de- 
fined. These regimes usually reflect physical behaviour of the systems under 
consideration and specification of protocols which govern the interaction of dif- 
ferent processes runnning concurrently in the system. For the single server queue 
considered in this section an overview and a comparison of different regulation 
schemes is given by Hunter [67], more recent are [51], and paying more attention 
to the effect of different regulation schemes for simultaneous events in networks 
of queues on the performance analysis of customer oriented quality of service, 
[39], [38]. 



Arrival At-\ 



Arrival At 



Xt Yt 

\ 1 





1 

-I- 

t+1 



Departure Dt 



Departure Dt+\ 



Fig. 2.3. Regulation of arrivals and departures in [18] 

In [18], p.345, the regulation of arrivals and departures is pointed out to be 
essential for proving quasi-reversibility of the process. It is assumed that early 
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departures occur at times t+ and arrivals enter the system at (t + 1)— in time 
slot [t,t + 1), see figure 2.3. The state process X is observed at slot boundaries 
t, and additionally a second state process Y is observed at times t + 1/2, as is 
done, e.g., in [51] as well. 

It should be noticed that the pathwise construction of the queue length pro- 
cess in corollary 2.2 coincides with the queue length process constructed and 
observed at the boundaries of the time slots in [18], p.346, but the structure of 
the transition probabilities in definition 2.1 differ from the the internal structure 
(intermediate jump probabilities) of their transition mechanism which requires 

P{^t+i = k\Xs, Dg, As '■ s <t, Xt+i, Dt+i) = P{At+i = k\Xt+i—Dt+i), t > 0 



to hold. But nevertheless in many cases the overall transition probability for the 
state process X can be represented in either way. 

The discrete time queueing system described so far is called a state depen- 
dent Bernoulli server. The term Bernoulli server stems from the case of state 
independent service and arrival probabilities (see corollary 2.7 below) and is ge- 
neralized to our setting. The fundamental characteristics of the system are well 
known from the discrete time birth and death chain theory, see remark 2.4. 



Theorem 2.3 (Steady state) Let X = {Xt : t G IN) with state space IN 
denote the queue length process of the state dependent Bernoulli server described 
above. 

X is a homogemeous Markov chain. 

If p{n),b{n) G (0, l),Vn G IN, then X is irreducible and aperiodic on IN. 

If X is irreducible and aperiodic on IN, then X is positive recurrent, hence 
ergodic, if and only if 



OO 



n=0 



rc Jo bj-m) rc Ji dim) 
n:=ocM n:=iPM 



< OO. 



(2.2) 



If X is ergodic then its unique stationary and limiting distribution tt = (7r(n) : 
n G IN) is 



7r(n) 



nrJoKm) nrJigM „-i 
n:=ocM'n:=iPM' ’ 



n G IV. 



(2.3) 



Proof : From the independence assumptions and the specification of the arrival 
and departure probabilities via queue lengths only it follows that X is a homoge- 
neous Markov chain. From p{n), b(n) G (0, 1), n G IN, we have P(Xt^i = n\Xt = 
n) > 0 and P(Xj_|_|^_„l = m\Xt = n) > 0, hence X is aperiodic and irreducible. 

The equilibrium equations x = x • p, where p is the one-step transition 
matrix of X and x = (x(n) : n G IN) is a nonnegative row vector, are solved by 



x{n) 



nrJoKm) nrJigM 

n:=ocM'n:=iPM’ 



n G IN. 



Normalizing x yields the probability solution (2.3) if (2.2) holds. 



G 
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Remark 2.4 (Random walks in discrete time) The queue length of the 
Bernoulli server, i.e., the Markov chain X, moves at most one step up or down 
in a time slot, i.e., it is a general random walk on IN (with reflection at 0) in 
discrete time in the sense of [77J, p. 84, or a birth and death chain in discrete 
time, see [66],(Vol. I), p. 178. Theorem 2.3 and the corollaries below are therefore 
simple consequences of the limiting and stationary behaviour of birth and death 
chains, see [67], (Vol. II), Example 7.2.2, p. 107. 

Remark 2.5 (Computational problems) Due to allowing the general form 
of arrival and service probabilities it is in general not possible to give closed form 
solutions for steady state probabilities (even if these exist). This is in parallel to 
the continuous time birth and death process theory. Even determing recurrence 
and transience has to refer to the data of the specific system under consideration. 
Eor details see: Hunter [67], Vol. II, example 7.2.2, p. 107. 

An example with explicitly given norming constant is provided by systems with 
state independent arrival and service probabilities as described in the corollary 
2.7 below. This yields a (homogeneous) random walk with reflection at 0. 

Notice that the problem discussed here is different from the usual problem of 
computing norming constants for large closed queueing networks, see section 
3 . 4 . Both problems will concurrently occur e.g. in explicity evaluating the steady 
state distribution in theorem 3.2. 

Remark 2.6 (Reversibility) Eor the case of state independent arrival pro- 
babilities, i.e., if the arrival process is a Bernoulli-(b) stream, Hsu and Burke 
[65] proved that in steady state the queue length process X is reversible in time. 
This implies that the departure process in equilibrium is a Bernoulli-(b) process. 
Eurther, in equilibrium, the departure process up to t and the state at t are in- 
dependent. This lead Hsu and Burke to apply separability properties to tandem 
queues. 

Eor random walks on IN in discrete time the Bernoulli property of the departure 
process means, that even with state dependent death rates the downstep process 
is homogeneous if the birth probabilities are constant. 

In [18], example 12.10, and the remark below on p.354, it is shown that this 
queue is quasi-reversible according to the definition 12.6 there. This again leads 
to the statement of Hsu and Burke on separably coupling such queues in a tan- 
dem. 

The system dealt with in theorem 2.3 is neither reversible nor quasi-reversible. 

Corollary 2.7 (State independent Bernoulli server) Assume that in the 
setting of theorem 2.2 we have p{n) = p € (0,1), and b{n) = b € (0, 1), n G IN. 
Then X is ergodic if and only ifb<p, and if this holds the stationary distribution 
of X is 



7r(n) 




n G IN. 



(2.4) 
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The arrival process is a Bernoulli process with probability b for successes and the 
service times are geometrically distributed on = {1,2,3,...} with parameter 
p. The interarrival times are geometrically distributed, and the service process can 
be thought to be regulated by a Bernoulli-(p) process. 

Weakening the assumptions on the arrival and service probabilities leads to some 
interesting special cases. 



Corollary 2.8 (Loss systems) Assume that in the setting of Theorem 2.2 we 
have b{n) € (0, 1), n < L — 1 >0, b(n) = 0, n > L. 

Then X is ergodic on E = (0, 1, . . . ,L|, and the stationary distribution of X is 
7T = (7r(n) : n G E) given by 



7r(n) 



nrio^M nriigM „-i 

ni=oc{m) ■ ui=M^) ■ 



n G IN, 



(2.5) 



where 

nriigM 

n:=iPM 



H 






is the norming constant. 



Example 2.9 (Deterministic service times) The case of deterministic ser- 
vice times is of specific interest, because in modelling transmission lines where 
cells with constant length are to be transmitted this constant cell length r con- 
stitutes a generic discrete time quantum such that IN ■ t = {0, r, 2r, 3t, . . . } is 
a suitable time scale for a process reflecting the development of the system over 
time. Assuming r = 1 and p{n) = l,n G and starting the system with 

P{Xq = n) > 0 for all n G IN, we find that X is not irreducible on IN . 

Indeed, if b{n) G (0, 1) for all n G IN , then X is irreducible and ergodic on 
E = {0, 1}. The stationary distribution tt is given by 



7t(0) 




7t(1) 



b{0) 

c(0)c(l) 



• H~ 



1 



which formally fits into (2.3). 

7/6=1 and P{Xq = n) > 0,Vn G IN +,P{Xq = 0) = 0, then X is stationary 
for any such initial distribution. 

The discrete time counterpart to the classical M/M/s/oo queue with s identi- 
cal service channels under FCFS poses surprisingly many problems with respect 
to analytical evaluation. No simple closed form expressions for the steady state 
seem to be at hand. Usually numerical procedures with root solving for multidi- 
mensional boundary equations are applied. Models related to that problem are 
dealt with e.g. in [15], [36] [126], [14], section 4.1.2, where the service time is de- 
terministic 1 while the arrival streams are more general. The case of no waiting 
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room is e.g. considered in [20]. The complexity of problems and the numerical 
difficulties which arise in using these multiserver queues in discrete time for mo- 
deling controled ATM switches are described e.g. in [112], where a leaky-bucket 
control is investigated in detail. 

Pestien and Ramakrishnan [107], section 3, proved that including these servers 
into a closed cycle of geometrical queues destroyes the product form equilibrium 
if s < oo. 

It is well known that in continuous time for the M/M/s/oo queue there 
exists an equivalent state dependent single server queue with the same steady 
state distribution. From the discussion above and the explicit steady state (2.3) 
it follows that such an equivalence is not possible in discrete time. However 
it is for a subclass of M/M/s/oo queues possible to construct a single server 
approximation in a rather direct way. 



Example 2.10 (Multiserver queue approximation in low traffic) 

Consider an MjMj sjoo queue in discrete time with Bernoulli arrival stream of 
intensity b G (0, 1) and service probability p G (0, 1) such that b < p ■ s holds. 
The conditional service intensity for that system (mean number of departures 
per time unit given the number of customer in system at the begin of a time slot) 
is the same as that of a single server state dependent queue according to theorem 
2.3 with service probabilities 



p(n) := p ■ min(n, s). 

Studying the behaviour of individual customers with respect to their delay be- 
haviour (waiting time and sojourn or passage time distribution) in equilibrium 
is a main topic in performance analysis. A first step towards this is determining 
under equilibrium conditions the state distribution at arrival instants, i.e., what 
an arriving customers observes just before he enters the system. To be more 
specific: An arriving customer observes at his arrival at t— exactly n other cu- 
stomers present, if at time t Xt = n + I holds and an arrival occurs. A customer 
who is to be observed during his stay in the node for determining (probabili- 
stic) characteristics of his behaviour is usually attributed to be a test customer. 
To deal with this notion and then to derive from a test customer’s behaviour 
conclusions about the behaviour of a typical customer needs care because e.g. 
knowing that a test customer commences his sojourn in the system prevents in 
general the system from being in equilibrium. The theoretical framework for de- 
aling with this problem is Palm calculus of point process theory (see [2]) which 
fortunately enough can be proved to reduce to investigate elementary conditio- 
nal probabilities in discrete time models (see [2], section 7.4). We formulate this 
as arrival theorems for customers, usually starting from a system in equilibrium. 



Theorem 2.11 (Arrival theorem) Let the queue length process X of a state 
dependent Bernoulli server he in steady state tt according to (2.3). Consider for 
t > 0 the event 
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A{t) = { At time t a new customer arrives at the system }. Then for n € IN 



7Ti(n) 



P{Xt = n+l\A{t)) 



Hm) rC=i Qjrn) ^ 



( 2 . 6 ) 



is the probability (with normalization constant Hi) that conditioned on an arrival 
at time t the arriving customer finds n other customers before him in service or 
waiting. 

We denote by tti = (7Ti(n) : n € IN) the arrival probability. The arrival state 
and arrival probability refer to the disposition of the other customers present, 
the new arrival is not counted. 



Proof : For t > 0 we compute elementary conditional probabilities P{Xt = 

n + l\A{t)) = 0 = n+l, Xt-i = r, A{t))P{A{t))-^ Q 



The common interpretation of tti is that it describes the distribution of the 
other customers’ disposition in an arrival instant at the node under equilibrium 
conditions, the jumping customer not counted. Remarkable is that this arrival 
distribution has not the form of the equilibrium of the system even if the arrival 
process is a state independent Bernoulli process.. In continuous time it is true 
for the case of state independent arrivals that the time stationary and customer 
arrival stationary distribution coincide. For open systems with external Poisson 
arrivals this is the celebrated PASTA property (Poisson Arrivals See Time Aver- 
ages) [141]. 

From a general point of view the PASTA theorem and its successors and re- 
latives determine the stationary and asymptotic distribution of systems when 
the observation points are prescribed by an associated (embedded) point pro- 
cess. Comparing the stationary distribution of the embedded state process with 
the time stationary distribution of the systems (seen by an outside observer) is 
the topic of many research activities in queueing theory. Since Wolff’s PASTA 
theorem [141] appeared the research in this field yielded many generalizations of 
that property. These have been proved and popularized under names like ASTA, 
EPSTA, MUSTA. For a review see [2], Chapter 4, Section 3, or [84], and [42], 
Chapters 3,4. Using point process terminology, EPSTA and its relatives are con- 
cerned with properties of special Palm measures of stationary point processes: 
Papangelou’s formula, which connects the point process intensity and time sta- 
tionary expectations with Palm stationary expectations, allows the derivation of 
a variety of formulas summarized under the title job observer properties in single 
node systems as well as in networks of queues. For continuous time, see e.g. [2], 
Example 3.2.2, [97], Example 3, [42], Section 4.3, and [35]. 

Starting from Palm theory in discrete time ([2], Chapter 1, Section 7.4) a similar 
development is possible. Palm measures in discrete time are expressed as elemen- 
tary conditional probabilities. This makes the theory more elementary although 
explicit computations are tedious, see sections 3.4 and 3.5. 

In discrete time, however, a PASTA analogue usually does not hold, although 
exceptions can be found under certain conditions. An early result was proved by 
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Halfin in [52]. Characterisation theorems of the PASTA type (thereby strengt- 
hening the BASTA-results (Bernoulli Arrivals See Time Averages) from [96]) 
were proved by El-Taha and Stidham [41], (see also [42], Section 2, Theorem 
3.18 and Corollary 3.19. Miyazawa and Takahashi [102] proved ASTA in a di- 
screte time point process setting by using a rate conservation principle. They 
also observed that for some natural systems this property does not hold. In this 
notes we prove “arrival theorems” for the different cases, where individual cu- 
stomers’ behaviour when entering the system is of interest. These provide us 
with the necessary basic information to compute customer oriented performance 
measures. The proofs can be performed either by applying the general theory or 
by directly evaluating elementary conditional probabilities, i.e. Palm probabili- 
ties in discrete time processes. The latter approach is generally chosen here. We 
assume in any case that the Markov process which describes the time evolution 
of the system is stationary. 

Note: If we rescale time, approaching in the limit a continuous time scale, 
our systems transform to exponential queueing system: Then in the limit the 
distinction between arrival distribution and steady state of the system disappears 
for state independent arrival probabilities. 

Because customers are scheduled according to FCFS regime the arrival theo- 
rem provides us with information about the number of services which will be 
performed before a test customer, who enters the system in equilibrium, will be 
served. This enables us in principle to write down the end-to-end-delay time 
distribution. But even for this simple single node, single server system explicit 
results seem to be not known in full generality. We consider the case of state 
independent service probabilities: 



Theorem 2.12 (End— to— end— delay) Consider the Bernoulli server with state 
dependent arrival rates b{n) € (0, 1) and state independent service rates p{n) = 
p € (0, 1) in equilibrium with a test customer arriving at time 0 finding the other 
customers distributed according to tti, see (2.6). We denote by a probability 
measure on {Cl,T) which governs the development of X under this conditions 
and by [■] expectations under . 

Denote by S this test customer’s total sojourn time in the system and by 

OO 

= J2p.,{s = s)e\ |0|<i, 

s=0 

the generating function (of the distribution) of S. If the generating function of 
the arrival factors in tt, see (2.3), is 

a{0) = f; \e\ < q/p, (2.7) 

^ rim=0 c(w) 

then 



«(|)-«( 0 ) 



| 0 |< 1 . 



( 2 . 8 ) 
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Proof : We have by conditioning 

OO 

= ^P,,(Xo = n+l)S,j0^|Xo = n+l] 



n=0 

OO 'Y’WTl 

lm=0 ‘ 



(^) ^ rim=o Km) fq 

hlCMm) \p 






-1 



p0 \”+' 

l-q0j 



In = we used that the service times of the customers are geometrically distribu- 
ted with parameter p on IN ^ and independent. From Hi = {p/ q){oi{q/p) — a(0)) 
the result follows immediately. 0 



2.2 Customers of Different Types 

In this section we consider the service system of section 2.1 and assume that 
customers arriving at the system may be of different types. All customers are 
served according to the same rules (FCFS) and have the same distribution for 
their requested amount of service. Later on the type description will determine 
a customer’s behaviour and service in networks of state dependent nodes, see 
section 5.3. The details: 

The node characteristics remain the same as in the previous section. Customers 
of different types arrive according to a state dependent Bernoulli process at the 
node, are served according to FCFS, and thereafter depart from the system. 
Joint arrivals and departures are scheduled according to LA-D/A regime {late 
arrivals and departure before arrivals), see [51]. 

We assume that there is a single chain of customers, all customers share the 
same type set M . The entrance type of an arriving customer is chosen according 
to the following rules: The external arrival probabilities depend on the history 
of the system only through the actual total population size of the system and on 
the type of the arrival, i.e., if at time t € IN there are n customers present, then 
a new arrival of type m appears in {t, t -I- 1] with probability 6(n) • a(m) G (0, 1). 

Departure and arrival decisions are conditionally independent given the ac- 
tual vector of queue lenghts. 

A typical state of the system is descibed by a type sequence x = {xi,. . . , Xn) G 
M”, where for n > 0 is the type of the customer in service, X 2 is the type of 
the customer at the head of the queue, . . . , is the type of the customer who 
arrived most recently. The empty system is denoted by x = e. (For definiteness 
we set for the empty system the queue length n = 0.) These states are sufficient 
for constructing the state space of the system where X is living on. 

Let X{t) denote the state of the node at time t,t G IN. X = (X{t) : t G JN) 
is a discrete time Markov chain with state space S := {e} U U^o 
transition matrix p = {p{x, y) : x,y G S). X is irreducible on S. The problem of 
stabilisation for this tandem system is solved by the following theorem. 
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Theorem 2.13 (Steady state) The Markov chain X is ergodic if and only if 



E 

{nelN 



\Yll=A^)j 



[lC=rPi^)J 



< oo. 



If this ergodicity condition is fulfilled, then the unique equilibrium distribution of 
X is TT = {'ir(x) : X € S) given by 



tt{x) 



tt{xi, ...,Xn) 

( Ul=oHm) \ 

vrim=o cM ) 




X = {xi, ... ,Xn) & S. 



rr-l 



(2.9) 



Proof : By inserting formula (2.9) into the equilibrium equation. We shall con- 
sider the case of networks of such nodes in detail below. 0 



Remark 2.14 (Steady state decomposition) Similarly to theorems 2.3, 2.11, 
we observe a decomposition (separation) of the steady states into factors con- 
cerning the arrival probabilities, the service probabilities, and in addition the 
type selection probabilities. This separability is common to almost all product 
form steady states in continuous time and will occur later on in the framework 
of discrete time queueing networks as well, see e.g. theorems 3.2, 3.5, 4.1, 5.4, 
and 5.9. The separability opens the way to search successfully for explicit perfor- 
mance measures. 



Our aim is to investigate an individual customer’s delay behaviour. We must 
therefore incorporate the types into an arrival theorem similar to theorem 2.11. 

Theorem 2.15 (Arrival Theorem) Consider the state process X of the node 
in equilibrium and denote by 

A{m,f) = {at time t a customer of type m arrives at the node} 
the arrival event of interest. Then 



T^i,m{x) = 



P{X{t) = ((xi, 

VnEEM/ U=1 

X = (xi, ... ,Xn) € S, 



,Xn),m)\A{m,t)) 



a{xk) 



( 2 . 10 ) 




Hi is the norming constant, which does not depend on the type of the arriving 
customer. 



For the interpretation of tti^™ see the remark following theorem 2.11. Note that 
the arrival distribution does not depend on the typ of the arriving customer. 
This is due to the fact that we consider an ’’open” system. For ’’closed” systems 
this property does not hold. 
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Corollary 2.16 (End— to— end— delay) Consider the Bernoulli server with state 
dependent arrival rates b{n) G (0, 1) and state independent service rates p{n) = 
p G (0, 1) in equilibrium with a test customer of type m arriving at time 0 fin- 
ding the other customers distributed according to TTi^m, see (2.10). We denote 
by Ptti rn ® probability measure on {fl, iF) which governs the development of X 
under this conditions and by ^ [•] expectations under ^ . 

Denote by S this test customer’s total sojourn time in the system. Then the 
generating function of the distribution of S is 



= Y.P-rr.iS=s)0^ 

s=0 



«(t^)-«(0) 

«(f)-«(o) 



| 0 | < 1 . 



( 2 . 11 ) 



Here the a(-) is the generating function of the arrival factors, given in (2.7). 

Proof : Because the arrival distribution does not depend on the individual type 
of the test customer, the factors concerning types cancel and we end with com- 
putations similar to those in the proof of theorem 2.11. 0 



2.3 Bernoulli Servers with Immediate Feedback 

Feedback queues are standard models in continuous time systems to model re- 
peated visits of an item to a production or service facility. Another situation with 
typical feedback structure is rework which occurs due to production control at 
the exit point of a production stage. A class of network models which encompass 
these features are re-emtrant lines which are surveyed in [90] in the continuous 
time setting, and which are to be described for the discrete time case in section 
4.4. 

Applications in the realm of ATM transmission systems are described in [113] 
where in a node with service time deterministic-(l) the feedback mechanism 
models the successive transmission of cells of a message, the length of which 
is geometrically distributed. An important consequence is that introducing the 
feedback destroyes the FCFS structure of the systems, which reflects real sy- 
stems’ protocol behaviour. In fact, the queueing regime used by the authors is 
what is called Round-Robin queueing discipline, and which is described in [93], 
see [92] and the refences there. We shall describe here the single feedback sta- 
tion in isolation, which will be used as the nodes of tandems to be considered in 
section 4.4. 

We consider a state dependent Bernoulli server under FCFS as described in 
section 2.1 with indistinguishable customers and introduce a Bernoulli switch at 
the departure point of the node. A customer departing from the queue leaving 
behind m — 1 customers is fed back into the waiting room (to the tail of the 
queue) with probability r(m). If he was the only customer present he will obtain 
immediately a further service, otherwise he will join the tail of the queue. With 
probability 1 — r(m) he will leave the system. The decision whether to leave 
or to reenter the node is made independently of anything else. The regulation 
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of customer movements in case of multiple events is: Departure before arrival 
for a joint arrival and departure (D/A) and feedback before arrival for a joint 
feedback and arrival (F/ A) . 

The queue length process X = {Xt : t G IN) with state space IN is Markovian. 
If 0 < b{-),p{-) < 1, then X is irreducible and aperiodic on IN. A short reflection 
shows: 

Observing the queue length process at times t G IN only is not sufficient to 
decide whether a feedback happened or no arrival and no departure happened 
or one arrival and one departure. We can determine from observing a path of X 
only single external arrivals and single departures to the external. The transition 
probabilities of the feedback queue are therefore 



p(0,0) 

p(0,l) 

p(0, to) 
p{n, n — 1) 
p{n,n) 
p{n, n + 1) 
p{n, to) 



c(0), (2.12) 

6 ( 0 ), 

0, TO 0, 1, 

c(n)p(n)(l — r(n)), n > 1, 

c{n){q{n) +p(n)r(n)) + 6(n)p(n)(l — r{n)), n > 1, 
b{n){q{n) + p{n)r{n)), n > 1, 

0, n > 1, TO yf TO, TO — 1, TO + 1. 



These transition probabilities are identically to those of a state dependent Ber- 
noulli server without feedback, with arrival probabilities 6(-), and with service 
probabilities p'(n) = p{n){l — r{n),c^ {n) = 1 — p{n){l — r{n)),n G IN. Therefore 
the Markovian queue length processes of these different systems are stochasti- 
cally indistinguishable, and we conclude that theorem 2.3 applies for computing 
the steady state of the feedback queue. 



Corollary 2.17 (Steady state of the feedback queue) Let X = (Xt : t G 

IN) with state space IN denote the queue length process of the state dependent 
Bernoulli server with immediate feedback. 

If X is irreducible and aperiodic on IN, then X is positive recurrent, hence 
ergodic, if and only if 

^ . V nrio Km) ui=M^) + p(m)r(TO)) ^ 

^rC=oc(w) Kn=iP{m)(l-r(m)) 



If X is ergodic then its unique stationary and limiting distribution tt = (7r(n) : 
n G IN) is 



7r(n) 



nrioKm) Ul=M^)+Pim)r(m)) , 

n:=ocM n:=iPM(i-Km)) 



(2.13) 



Note that even in the case of state independent arrival, departure, and feedback 
probabilities the effective arrival stream at the waiting room, i.e., the superposi- 
tion of the external arrival stream and the feedback stream, is neither geometrical 
nor a state dependent Bernoulli arrival process as defined in section 2.1. 
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We consider now a feedback node where customers of different types from 
the set M of possible types are served, i.e., the model of section 2.2 with a queue 
length dependent Bernoulli feedback as described before. The state space for a 
Markovian description is S' = {e} U IJ^i defined before theorem 2.13. 

We notice that we usually can realize the occurrence of a feedback by a resulting 
permutation of the customers. We even can decide when a batch arrival due to 
a simultaneous feedback and external arrival appears. The only exception: All 
customers present are of the same type. 

Consequently the transition probabilities of the feedback node have no lon- 
ger an interpretation in terms of a Bernoulli node without feedback and suitably 
adjusted service probabilities. In the light of this the following result is some- 
what surprising. The proof is straight forward but tedious checking the balance 
equations. 

Theorem 2.18 (Feedback queue with different customer types) Let X = 

(Xf : t G IN) with state space S denote the Markov chain describing the evo- 
lution of the state dependent feedback queue with different customer types. If 
p{n),b{n) G (0, 1), and r{n) < 1 for all n G IN, then X is irreducible and aperi- 
odic on S. 

If X is irreducible and aperiodic, then X is positive recurrent, hence ergodic, if 
and only if 



„ V nr=>M ^ nrii(gM+pMr(m)) 

^oni=ocM rC=iP(w)(l-r(m)) 

If X is ergodic then its unique stationary and limiting distribution tt = {tt{x) : 
X € S) is 

Tr{xi,...,Xn) (xi, . . . ,x„) G 5, (2.14) 

ni=oKm) A . . nrii(gM+pMKm)) , 

n:=oc(m) n:=iPM(l -r(m)) 

We obtain the round-robin discipline dealt with in [113], where service time 
is deterministic-(l) and the total system time being geometrically distributed, 
by putting p(ri) = 1 for all n > 1 and the feedback probability being state 
independent as well. Nevertheless, the model in [113] includes several further 
modeling features not represented in the simplified feedback Bernoulli server 
here. In [93], [92] it is assumed that the number of packets arriving per slot 
is determined by a sequence of identically distributed random variables (batch 
Bernoulli arrival process), the service time is of (discrete) phase type, and the 
service mechanism is round-robin. Due to the general arrival process the steady 
state of the queue length process is no longer of product form, as it is in case of 
state dependent single arrivals of different customer classes [32] . 




Chapter 3 

Closed Cycles of State 
Dependent Bernoulli 
Servers with Different 
Customer Types 



In this chapter we study networks of Bernoulli servers in discrete time: Closed 
cycles with a fixed number of customers cycling. These are the analogues of 
cycles of exponential single server queues in continuous time under FCFS-regime, 
[50], [85], 

We construct cycles with state dependent node behaviour and multiple cu- 
stomer types as described in section 2.2 and give references to the more classical 
results as corollaries. In section 3.1 we determine steady state behaviour and 
the individual customers’ behaviour at arrival instants at the nodes. We concen- 
trate on the unichain case throughout the notes because it reduces complexity 
of the presentation. The multichain case can be discussed along the same lines 
but with much more involved notation. The principle differences are sketched in 
section 3.2. 

In section 3.3 we determine individual sojourn time distributions at the nodes 
for a travelling customer throughout his passage through a cycle. We end with 
explicit expressions for the generating function (z-transform) of the vector of 
the successive sojourn times which can be inverted easily by direct methods. 
Although these results are explicit, it turns out that similar to the continuous 
time case there are problems with numerical evaluation. We sketch in section 3.4 
algorithms to compute the norming constants which occur in the probabilities 
obtained before. 

Of historical interest is the time lag in the development of classical results, 
a remark on this may be in order here: The first explicit result on the steady 
state behaviour for closed cycles of state independent Bernoulli servers appeared 
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in 1994 - see [107] and [106]. The parallel result for open series of such nodes 
appeared already 1976, see [65]. An explanation for the time lag between finding 
these parallel results is the combinatorial complexity of the closed system which 
cannot be escaped by proving time reversibility of the nodes’ local state process 
in equilibrium as it was done in the open network case by Hsu and Burke. The 
direct proof of the steady state result by Pestien and Ramakrishnan [107] will be 
substituted here by considering the time reversed network process in conjunction 
with the original process (theorem 3.2 and proposition 3.3). 



3.1 Steady State Behaviour and 
Arrival Theorem 

We consider a closed cycle of state-dependent Bernoulli servers under FCFS 
queueing regime with unlimited waiting room. There are J nodes in the cycle, 
numbered 1,2, ...,J; customers leaving node j proceed immediately to node 
j + 1. (We formally define for the numbering of the nodes J + 1 := 1 and 
1 - 1 := J.) 

K customers cycle in the system being of specific types mGM, 0<]Mj<oo. 
Customers may change their types according to a Markovian selection rule when 
departing from a node. All customers show the same behaviour with respect to 
changing their types. (The unichain case.) 

With probability r{i;m,m') > 0 a customer of type m on leaving node i 
becomes a customer of type m' G M when entering node i+l, f = 1, . . . , J. Given 
i and m, the selection of m' is done independently of anything else in the past 
of the system. We do not put further assumptions on the probability matrices 
r(i) = (r(i;m,m') : m,m' G M), so e.g. cyclic or deterministic behaviour of the 
type change process is possible. We only assume that the system of equations 

T]{i;m) = rj{i — l;m')r{i — l;m' ,m),i = 1, . . . , J,m G M, (3.1) 

m'eM 

has a unique stochastic solution rj = {r]{i; m) : i = 1, . . . , J,m G M). 

The evolution of the system will be described by a multivariate discrete time 
stochastic process X := {X{t) : t G IN) as follows: Let M{i) = {m G M : 
r](i; m) > 0} denote the set of possible types which customers may show when 
staying in node i,i = 1,...,J. A typical state of the system is denoted by 
X = {x\, . . . ,xj), where Xj = Cj or Xj = (xji, . . . , Xjnj) G M(j)”^',l < nj < 

K,j = 1, . . . , J, and ni H \-nj = K. Xj is called a local state for node j with 

the following meaning: 

If Xj = Cj then node j is empty and we set rij = 0. 

If Xj = {xji, . . . ,Xjnj),nj > 0, then a customer of type Xji is in service at 
node j, Xj 2 is the type of the customer waiting at the head of the queue, . . . , 
and Xjrij is the type of the customer who arrived most recently at node j. These 
local states are sufficient for constructing the state space of the system 

S:=S{K,J) := 
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:= {{xi, ...,Xj):Xj = {Xji, . . .,Xjn^) e = I, . . . , J,rii h nj = K}, 

where X = (X{t) := (Xi{t), .. ., Xj{t)) : t > 0) is living on. 

We assume that the nodes operate independently as single channel state de- 
pendent Bernoulli servers under FCFS with ample waiting room for all customers 
cycling. If at time t at node j a customer is in service and if there are h — 1 > 0 
other customers present at that node then this service ends in the time segment 
[t, t-l- 1) with probability Pj{h) G (0, 1) and the departed customer will be at the 
end of the queue of node j -I- 1 at time t + 1; with probability qj{h) = 1 — Pj{h) 
this customer will stay at least one further time quantum at node j, j = 1, . . . , J. 
The decision for a customer whether to stay or to leave is made independently 
of the history of the system given the local actual state of X at j. A customer 
arriving at node j -I- 1 at time t -I- 1 will either join the end of the queue there (if 
other customers are present) or immediately enter service (if at time t node j was 
empty or there has been exactly one customer who obtained his last quantum 
of service time). If at some node at the same epoch an arrival and a departure 
occur at the same node we always assume that the departure event takes place 
first. {D/A-rule; departure before arrival, see [51].) 

The state of the system is recorded at times t G IN just after possible de- 
partures and arrivals had happened. (Note that due to the ample waiting room 
assumption the A/D-rule (arrival before departure) will yield the same steady 
state distribution of the discrete time state process. 

S{K, J) is not necessarily the minimal state space. The set of those states 
which X will enter with positive probability may be a subset of S{K,J), de- 
pending on the initial state of the process. This is due to the cyclic structure of 
the system which prevents customers from overtaking one another. We therefore 
assume that the following holds. 

Assumption 3.1 (Irreducibility) Depending on the initial state X is irredu- 
cible on its state space. We denote the state space in any case by S{K,J), the 
meaning of which will always be clear from the context. 

Theorem 3.2 (Steady— State Distribution) The Markov chain X = (X(t) : 
t G IN) is positive recurrent and its unique stationary distribution 
. J. g S{K, J)) is given by 

7T^’“'(a;ii, . . . , xinp, ...;xji,..., xjnj) (3.2) 

(xii,...,xjnj) G *S(AT, J ) , 
where G{K,J)~^ is the norming constant. 

Proof: From finiteness of the state space and the assumption on the unique 
stochastic solution of (3.1) positive recurrence follows. Instead of solving the 
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equilibrium equations directly the rest of the proof is done by considering the 
time reversal of X and hence part of the proof of the following proposition [31]. 

G 



Proposition 3.3 (Time Reversed Chain) Denote by X = {X{t) : t G Z) 
the stationary continuation of X under on time axis Z as well. Then the 
time reversal of X 

X = (X{t) := X{-t) :t&Z), 

describes a closed cycle of state-dependent single server nodes with the same 
node characteristics as the original system but with K customers cycling in the 
reversed direction. The type set of the customers is the same and type changes are 
governed by Markovian matrices f{i) = (f(i; m', m) : m', m € M), i = 1, . . . , J, 
given by 



r{i + 1; m' , m) 



r{i; m, m') 



r]{i; m) 
rj{i + 1; m') 



(3.3) 



For state x = {x \, . . . , xj) G S{K, J) of X the local states Xj = {xji , . . . , x„^.) 
are to be read as follows: If nj > 0 a customer of type Xjn^ is in service at node 
j, Xjnj-i is the type of the customer waiting at the head of the queue, . . . , and 
Xji is the type of the customer who arrived most recently at node j. 



Proof: Let p = (p{x,y) : x,y G S{K, J)) denote the transition matrix of X and 
p = {p{x, y) : x,y G S{K, J)) the transition matrix of X. For any x,y G S{K, J) 
we have to show (see proposition 7.2 in the appendix.) 

■K^'\x)p{x, y) = ■n^'\y)p{y, x). (3.4) 



Let for X = {x\, . . . ,xj) G S{K; J), Xj = {xji, . . . ,Xjnj), J = 1, ■ • ■ G denote 
A{x) := {j G J} : Uj > 0} the set of busy nodes when the network 

is in state x. One-step successor states y = {yi, . . . ,yj) G S{K,J), yj = 
{yji, . . . ,yjmj),j = 1, . . . , J, of X, y ^ X, can be determined as follows and are 
selected according to the following probabilities: 

(i) Chose some B C A{x),B yf (/>, B yf {1, . . . , J}, with probability 

Y[Pjinj)- n 

j&B j^A(x)-B 

At nodes in B a service will expire at the end of the present time slot. 

(ii) For the customers of type Xji, being in service at node j and now being 
selected to leave that node, j G B, chose their new types when arriving at node 
j + 1 to be yj+i^nij+i with probability 

Y[r{j-,Xji,yj+ym^^,) . 
jeB 

For B C A{x),B y^ </>, B y^ {1, . . . , J}, define 

E{B) = {jG{l,...,J}:jGB,j-l^ B}, {the END of B) 

and 

E{B) = {jG{l,...,J}:j-lGB,j^ B}, {tn FRONT of B). 
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Then (3.4) with (3.2) reads 

• n ■ n n a^ii, 2/i+i.m,+i) 

j&B j£A(x)-B j&B 



(3.5) 



.J / mj \ 

= ^ n n 

j=i Vfc=i / 



nriiP.w 



n 

j&(B-E{B))UF(B) 



n n 

ie(.4(x)-B-F(B))u£(B) je{B-EiB))UF{B) 



Pjimj) 



First: Note that there is a bijection between those nodes being active in state 
X and showing a departure which leads in the original system from x to y and 
those nodes being active in state y and showing a departure which leads from y 
to X in the time reversed system. This bijection is given by: 

{B - E{B)) U F{B) = {j e {1, . . . , J} : j - 1 G 5} and 
B = {j G {1, . . . , J} : j + 1 G (B - E{B)) U F{B)}. 

Second: From the definition of r(-; •, •) it follows that for j G B (and therefore 

j + Uz(^B-E{B))[JF{B) ) 



vU'^Xji) ■ r{j]Xji,yj+i^m^^,) = v{j + 1; , x^i) • r{j + l;yj+i,jn^_^_^,Xji) 

Third: Note that for j G E(B) m, = n, — 1, for j G F(B) to, = n, + 1, and for 
jG{l,...,J}-F{B)-E{B)mj=nj. 

Therefore (3.5) reduces to 



y 'v niuMh) ^ 



■Y[pjinj)- n 

jeB j^A{x)-B 



UlLl'qjih)' 






TT ( ri/iLl djW I TT 

i|B) \n7=,"pAh)) vnri>.(^) 



n 



ie{l....,J}-B(B)-F(B) 



. ]Th=iP3ih) 



(3.6) 



n pjK+ 1)- n 

KieF{B) jeB-E(B) 

n 9 j(nj - 1)"^^’”^'^ • n 

ViSF(B) jeA(x)-B-F{B) 



The rest of the proof is checking carefully (3.6). 



G 
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For obvious reasons the steady state distributions are said to be of pro- 
duct form, which merely reflects the similarity with the well-known continuous 
time results. In the closed network case this clearly does not imply indepen- 
dence of the steady state queue lengths. The structural difference between the 
equilibrium (3.2) and the continuous time analogue (see e.g. [75]), is clarifled 
when considering the case of state independent service probabilities Pj{rij) = Pj. 
Theorem 3.2 then simplifies to 



Corollary 3.4 Suppose we have Pj(jij) = Pj,n € lN+,j = 1, . . . , J. Then the 
unique stationary distribution of X is : x G S{K, J)) given by 



./ / "j \ / 1 \ ri(0,nj) 



(3.7) 



n’ 



(xii, . . .,Xjnj) G S{K, J). 



G{K,J)-\ 
P], 



f , \v(0,nj) 

It is the extra factor ( ^ 1 for non empty queues which sets the difference. 

This factor e.g. is the reason why in the totally homogeneous cycle (pj = p,j = 
1, . . . , J) the stationary distribution is not the uniform distribution on S{K, J) 
as it is the case in continuous time. For conseqences of this observation see [106]. 

( \ r}{0,rij) 

^ j in (3.7) cannot be extracted in the general 
setting of theorem 3.2 because the missing factor qj(n) in the denominator there 
is not connected with (the appealing interpretation from (3.7)!) whether the 
node is empty or not, but is determined by the actual queue length. 

The result of corollary 3.4 and even the case of state dependent service pro- 
babilities can in principle be proved by applying theorem 2.2 of [58] or by similar 
derivations as presented in section 4 of [8]. 

As pointed out in the introduction, we want to optimize systems with respect 
to throughput under constraints which are put on the behaviour of individual 
customers (cells). Possibly the more important problem might be the case of open 
systems. But it is well known from the continuous time setting that the closed 
case is important for such systems as well, e.g., when controlling open systems by 
window flow control mechanisms - see [110] and [111]. Further, from the results 
obtained in the closed case several results for open systems can be proved using 
limiting procedures. This is the case here as well. So we shall concentrate in the 
following on the computation of performance measures for the closed cycle of 
Bernoulli servers and turn in the next chapter to open systems. 

To investigate the individual behaviour of customers we have to compute 
first the distribution of the network seen by a customer on his transit from one 
station to the next. It turns out that this arrival distribution is not the steady 
state of the system. This is clear in the closed cycle case but will occur in the 
open network case again. The latter is again in contrast to the continuous time 
analogue. 
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In continuous time a direct consequence of the product form equilibrium is 
the celebrated Arrival Theorem, [94], [123], which roughly states, that in equi- 
librium an arriving customer at node j observes the other customers being dis- 
tributed according to the equilibrium of the same system if he himself would 
not be there, j = 1,...,J. So the arrival distribution has the same structure as 
the equilibrium, and it is inpendent of the node j, where the customer arrives. 
( More formally: Interpreting the arrival distribution as Palm probabilities for 
product form queueing networks in equilibrium, we find that the Palm distribu- 
tion is of the same product form structure as the equilibrium itself. See [86] for a 
discussion.) In our discrete time setting Palm distributions reduce to elementary 
conditional probabilities. For more details see the discussion after theorem 2.11. 

Proposition 3.5 (Arrival Theorem) Let X = {X{t) : t G Z) he the statio- 
nary continuation of X = (X{t) : t G IN) under ^ Assume that for node 
i and customer type m there exists some m' such that r{i — > 0, i.e. 

m G M{i), and denote by A{i,m) the event that at time 0 an arrival of a type- 
m customer at node i appeared, i G {!,..., J}. Then for x = (xi, . . . ,xj) G 
S(K-1,J) 



(3-8) 

:= P{X{0) = {{xi , . . . ,Xi_i, . . . ,Xj)\A{i,m)) 



\fc=l 

J / nj 

n n vU',Xjk) 

\fc=i 



, UhLiPjW . 



J) 



-1 



where J) ^ is the norming constant. 



Proof: We abbreviate X{t) =: Xt for t > 0, and consider the case i = 1 where 

’^l,m (2^1> • ■ • > 

= P{{Xo = (xii , . . . ,Xin,_,m),X 2 , ■ . ■ ,a:j)} n A(l,m)) • P(A(l,m))“\ 

Denote ((a;ii, . . . , xim , m),X2, . . . , xj) =: x, then 

P{{Xo = (xii, . . . , xin^ , m), X2,..., xj)} n A(l, m)) 

= ^ P({Ao = (xii,...,xi„i,m),a; 2 ,...,xj)}n{A_i = j/}nA(l,m)) 

V€S(K,J) 

= X! h{iX_i,Xo) = {vA)}CA(l,-m)]P{N_i = y,Xo = x) 
yeS{K,J) 

= X! M{(X^i,Xo) = (v,x)}<ZA(l,m)]P{NQ = x) ■ P(A_i = y\Xo = x) 

V&S(K,J) 
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=pi("i+i) 

= TT^"^{x)- J2 M{{X_^,Xo)=(y,D}QA{l,m)]P{x,y) 

V&SiK,J) 



ni 
k=l 

J / rij 

n n vU', Xjk) 

j^2 \k^l 





nz^piih) ) 

\ 

) \ U:UMh) ) 



■ 77 ( 1 ; m) 



• G{K, J) ^ - 771(711 + 1). 



It follows 

"^l,m (^1 5 ■ ■ ■ 5 ) 

and 

is the norming constant. Q 

A different form of an arrival theorem was proved by Henderson and Taylor 
([58]): They computed in a rather general setting the disposition probability for 
stay-on customers seen by a prescribed set of departing customers just before 
the latter enter their destination node. These probabilities can be computed in 
a way similar to the proof of theorem 3.5. 

And the other way round: Having the arrival probabilities of [58], Corollary 2.4, 
at hand, by a suitable, but lengthy, summation our result specialized to the case 
of indistinguishable customer would follow. 

The elementary proof given for the case of networks with different customer 
types is from [27]. 

Remark 3.6 We extend our definitions to include computations concerning dif- 
ferent population sizes: 

For any k € IN S{k,J) is the set of configurations which a population of k cu- 
stomers with possible types M at the J nodes may show. (Recall the Assumption 
3.1 and the remarks there. These apply here again.) 

The remarks on the steady state and arrival probablities can be summarized: 

defined on S{K — 1, J) and holds in contrast to the con- 
tinuous time case where holds. Further in continuous time we 

have while in our discrete time cycles yf holds. 

Some further details of the connection between norming constants in different 
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systems of similar structure can he found in [136], pp. 144,145. It is shown there 
that a fixed sequencing of customers in a cycle without the possibility of overta- 
king causes even in continuous time , where again the LHS is to 

be read as the steady state in a system without customer m. This phenomenon 
occurs here as well. 



3.2 Closed Cycles of Bernoulli Servers — 

The Multichain Case 

Many applications in computer and computer communication performance eva- 
luation require to distinguish between different classes of customers (jobs). Jobs 
of a specified class (chain) are indistinguishable with respect to their behaviour 
in the system but may individually show a versatile behaviour as described in 
section 2.2. For a short introduction into the models and the necessary techni- 
ques for continuous time systems see [37]. We describe the modeling principles 
in the framework of cyclic queues and point out the differences arising compared 
with the unichain case. 

Consider a closed cycle of state-dependent Bernoulli servers as described 
in Section 3.1 where customers belong to different chains which define their 
behaviour with respect to the types. The set of customers is split into k disjoint 
subsets ICg with \ICg\ = Kg G lN+,g = l,...,k, X)g=i Each set ICg 

constitutes a specified chain of customers which are undistinguishable within 
each chain. So each set ICg is associated to a subset Mg C M of types, where 
the Mg are pairwise disjoint with X/g=i ~ customer ever leaves his 

associated set ICg or set Mg. For the matrices r(i) it follows: 

r(i;m,m') > 0 only if m,m' G Mg for some gG k}. 

We now assume that for each set ICg, g G {1, . . . , A:} the system of equations 

r](i; m) = r](i — 1; m')r(i — 1; m', m), i = 1, . . . , J, m G Mg, 

m'^Mg 

has a unique stochastic solution 77 = (77(7; m) : i = 1, ..., J, m G Mg). (Note 
that type m determines g. Kg, and Mg uniquely.) 

The state space of the describing process X = (X{t) : t > 0) is denoted again 
by 

S:=S(K,J), 

which is now defined by 

{(xi,...,xj)G S(K, J) 

Xj = (xji,...,Xjn^) G M(j)’^Cj = !,■■■, J, 

J "7 

and EE ^ ^5} — 9 — 1, . . . , A;. 

j-i h^i 
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In the multichain case we have a complete analogue of Theorem 3.2 and 
Proposition 3.3, which especially yields (remember the Assumption 3.1) for the 
steady state probabilities that they are of the form (3.2), with S{K,J) as de- 
scribed here. The reformulation of the arrival theorem for the multichain case is 
slightly more involved, but using the notations of Section 3.1 with a more elabo- 
rated interpretation yields formally (3.8) again. The problem is: Prescribing for 
some node i and type m the event A{i, m) G T, that at time 0 a type-m arrival 
at node i appeares, we have fixed the chain, say /C/, where the arriving customer 
belongs to, / G {1, . . . , A:}. For different chains the possible dispositions of the 
other customers seen by the arrivals will be different and 

:= P(A(0) = ((a;i, . . . , Xi_i, (xip, . . . , a;*,™,, m ), . . . ,xj)\A{i,m)) 
is now defined for 

(xi, . ,.,xj)& Sf{K, J) 

only, where 

{(xi, . . . , xj) G Sf{K, J) 

~ ) ■ • ■ ) ^jrij ) G M ^ (j) , J = 1, . . . , T, 

and EE l{Xjh ICg} = kg, VgG {l,...,fc}-{/} 

i=l h=l 
J "3 

and EE 

j = l h=l 

In the rest of the notes we shall restrict our attention to the unichain case. 
The way the results carry over to the multichain case will always be obvious. 
Adapting the closed cyle and the open tandem performance evaluation to the 
multichain case is then direct by using the techniques of the previous sections. 



3.3 Delay Time Distribution for Customers in a 
Closed Cycle of State Independent Bernoulli 
Servers 

For a closed cycle of J state independent Bernoulli servers under FCFS queueing 
regime with unlimited waiting room as described in section 3.1 and specified in 
corollary 3.4 we derive the steady state cycle time for a customer in the system, 
and similar quantities. Most important is to determine the joint distribution of 
successive sojourn times of a customer at the different nodes during such a cycle. 

From the arrival theorem 3.5 and the type independent service times it follows 
that these distributions do not depend on the type of the cycling customer. We 
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therefore can and will restrict our attention to the case of indistinguishable 
customers. For ease of reference we state the relevant steady state results for 
this specific case before preceding. 

A Markovian description of the time evolution of the system is provided by 
the joint queue length process X = (X{t) : t G IN) with state space 

S{K,J) = {{xi,... , xj) G JN"^ : xi + . . . + xj = K}. 

X records the development of the joint queue length vector, i.e., X{t) = 
(Xi{t), . . . ,Xj{t)) = (xi, . . . ,xj) indicates that at time t there are Xj customers 
present at node j, including the one in service, if any, j = 1, . . . , J. For the 
Markov chain X the following corollaries specialize the results of section 3.1. 



Theorem 3.7 ([107]) X = (X{t) : t G IN) is ergodic on S{K,J) with unique 
limiting and steady-state distribution = {tt^’'^{x) : x G S{K, J)) given by 



■J / 1 \ v(0,Xj) / 

r^’-'(xi,... ,crj) = n(-) [yj ■G{K,J)-\ (3.9) 

(xi , ... ,xj) € S{K, J), 



where 7]{a, 5) = -j ^ ^ ^ ^ , and the norming constant is 



/ 1 \ viO.Vj) /„ \Vj 

^ s n(G) (£ 



(vi,... ,yj)eS(K,j) j= 



Proposition 3.8 Let X = {X{t) : t G Z) be the stationary continuation of 
(X{t) : t G IN) under , and 

X = (X{t) : t G Zi) its time reversal, defined pathwise by 
X{t,uj) = X — t,Lo),t G uj G fl. 

Then X is the steady-state joint queue length process of a cycle of queues 1,2,... , 
J, with Bernoulli servers under FCFS. The parameter of the geometrically dis- 
tributed service times at node j is pj,j = 1,...,J. A customer leaving node j 
proceeds to node j — 1, where 1 - 1 := J. Shortly: 

The time reversal X of X describes the evolution of the system when the 
direction of customer movements is reversed. 

t^kj jg g^j^ product form ([107]), resembling the specification of the 

analogous steady-state probabilities of continuous time systems, see [75]. In fact 
their result is stated in a slightly different, but equivalent form: Our extra factor 
/ , \v(0,Xj) _ _ S(0x ) 

( ^ 1 for non-empty nodes is substituted by an extra factor qf ’ for 

empty nodes, and the norming constant is changed accordingly. 
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Theorem 3.9 Let X = (X{t) : t £ Z) he the stationary continuation of (X{t) : 
t £ IN) under and denote by A{i) the event that at time 0 an arrival at 

appeared at node i, i £ {1, . . . , J}. 

Then for {x \, . . . , xj) with x\ + ... + xj = K— 1 



,Xj) 

:= P{X{0) = (xi, . . . , Xi-l,x^ + 1, Xi+i, . . . , xj) I A{i)) 



(3.10) 



where Gi{K,J) is the norming constant. 



Remark 3.10 (a) Similarly to remark 3.6 the arrival probabilities in discrete 
time cyclic queues depend on where there arrival appears: (3.10) is asymmetric 
with respect to the node number i, and the arrival probabilities keep trace of the 
arriving customer - which is not the case in continuous time. 

(b) Extending our definitions to general finite population sizes and node sets 
we shall use expressions like S{K — k, J — , etc., the meaning 

of which will be clear from the context. In continuous time we then have on 
S{K — 1, J): i = 1, . . . ,J, ([123] and [94]) while in discrete time 

we have xf''’ ^ , and ^ for i ^ j,i, j = 1, . . . , J . 



We now consider a test customer Co arrivir^ at time 0 at node 1 who finds 
the other customers distributed according to Let (S'!, . . . , Sj) denote the 
vector of Cq’s successive sojourn times (=waiting time + service time) at the 
nodes during his first cycle starting at time 0. 

We denote by a probability law on (12, .4) which governs the evolution 

of the system under this condition, and by E^k,j[-] expectations under P^k.j . 
We shall prove the following theorem [29]: 

Theorem 3.11 The joint distribution of the vector {S \, . . . , Sj) is given by its 
generating function 




(3.11) 




3.3. Delay Time Distribution for Customers 



35 



It is important that the appealing interpretation of the RHS of (3.11) as a direct 
result of conditioning on the arrival situation is false: 

(r^) n|(r^) (^) ) 



is not the joint conditional joint sojourn time distribution C{Si, . . . ,Sj \ ^(0) = 
{x\ + 1, X 2 , • ■ • , xj)). The proof of this can be done by inserting these expressions 
into the set of first entrance equations for the conditional sojourn time LST in 
(3.21) and then verifying that they do not solve the system. 

Interchanging the numbering of the nodes we have an immediate result for 
other cycles. Note that in the transform formula (3.11) the asymmetry of (3.10) 
formally reappears, but compare this with the statement in Corollary 3.15 below. 



Corollary 3.12 If Cq arrives at time 0 at node i € {1, . . . , J}, finding the other 
customers distributed according to and z/ (S'J*\ S' 2 *\ . . . ,*S'j^) denotes the 

vector of his sojourn times during his cycle which starts at 0, then 

j 



E 



K,J 



m 



(0 



E ft ( AW )-- nil 

(xi,... ,Xj)€S{K-l,,J) l^i=l ^ 

J f / 1 \ a{o,xj) 

n 

i=i J#* 



Qit 



1 - qiOi, 

|<l,j = l,... ,J. 



1 




(3.12) 



Proof of Theorem 3.11: The proof is by induction on the length of the cycle 
and the number of customers. We consider the cycle built of an initial node 
connected to a smaller residual cycle with less customers cycling, where the in- 
duction hypothesis applies. 

We describe the dynamics of the network during Cq’s first cycle after 0, recording 
carefully the actual position of Co relative to the other customers. A sufficiently 
detailed description of the system will be provided by using the following nota- 
tion: 

Let for z G {1, . . . , J} be ij, X\,X2, . . . ,xj G IN such that ij -I- X)/=i = 

K — 1. Then saying the network is in state 



(xi, . . . , X^—i, Xj I Xj, Xj-|_i, . . . , Xj) 

means that there are Xj customers present at nodes j G {1, . . . , J} — {z}, Cq is 
present at node i, seeing exactly Xj other customers before and Xj other customers 
behind him. 

We denote the set of all such possible states, where Co is represented by the 
vertical bar at some node z,z = 1,... , J, by S{Cq). Using this notation, the 
possible arrival states for Co at node 2 are of the form (xi, 0 | X 2 , X 3 , . . . , xj), 
where (xi, X 2 , . . . , xj) G S{K — 1, J). 
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The dynamics of the system during Cq’s first cycle is described by a Markov 
chain Z = (Z{t) : t > 0) on the state space S'(C'o). The transition law and the 
behaviour of Z are coupled with that of X in an obvious way. We therefore use 
similar notation for quantities connected with these processes. E.g., we define Z 
on an underlying probability space (D,,A,P^k,j), which means 

P^K. j{Z{0) = {0 \ xi,X 2 ,. ■■ ,xj)) = tt^’‘^{xi,X 2 ,... ,xj), (3.13) 

{xi,X 2 ,... ,xj) G S{K - 1, J). 



It should be noted that Z under P^k,j is not stationary; because P^k,j is a 
probability measure we conclude from (3.13) for ii > 0 



P^K,j{Z{0) = {xi I Xi,X 2 ,... ,xj)) = 0, V(a;i,a: 2 , ■ ■ ■ ,xj) G S{K - xi~l,J). 

We denote the 1-step transition law of Z by = {p^[x,y] : x,y G S'(C'o)). 
Our first step in analyzing the distribution of {Si , . . . , Sj) is applying the total 
probability formula to discriminate between different arrival dispositions seen by 
Cq on his arrival at node 2: 



j 




1=1 



(xi,... ,xj)^S{K—l,J) ti — 1 



(3.14) 

(a;i,0 I X 2 ,xs, . . . ,xj))9\^ 



E 



K,J 



n I = ii , Z{Si) 



1=2 



(a;i,0 I X2,X3,... ,xj) . 



The key step of our proof is the following lemma the proof of which will be 
postponed to the end of this section. 



Lemma 3.13 The joint distribution of {Si, Z{Si)) under P^K.jis given by 



ti=i 

_ K,J 



E P^^.j{Si = ti,Z{Si) = (xi,0 I X2,X3,... ,xj))0*i (3.15) 

PiO 



= 7T2 ’ (a;i,X 2 , ... ,xj) 



1 - qid 



Xi + l / rj(0,xi) 



The strong Markov property of Z ensures that {S 2 , ■ ■ ■ ,Sj) is conditionally 
independent of Si given Z{Si) = (xi,0 | X 2 ,X 3 ,... ,xj). Using this property 
and inserting (3.15) into (3.14) yields 



J 




Lj=i 



(3.16) 



E 

{xi,X2,... ,xj)gS{K—1,J) 



,K,J 



{xi: 



X2, 



,Xj) 



P1&1 
1 - qi9i 



Xi + 1 



v(0,xi) 
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E 




I Z(0) = (Xi,0 I X2,X3, ... ,xj) 




G2{K 



X\, J - 



1 ) ^ G2{K 

(a:2,a:3 V ■,xj)^S{K—l — x\,J—l) 



XyJ-l)-^ 




X2 



J 

n 




E 




I Z(0) = (xi,0 I X2,X3, ... ,Xj) . 



We now use the overtake-free property of the closed tandem system under con- 
sideration; during one cycle of Co customers who jump (from node J) to some 
node behind Co can no longer influence Co’s future sojourn at the nodes of his 
residual cycle. This justifies the following equation: 

For (x 2 , X 3 ,... ,xj) & S{K - xi-l,J -1) 



E 



= E 



J 

I Z{D) = (xi,0 I X2,X3,... ,Xj) 

i=2 
,7 

I Z(0) = (0 I X2, X3,... , Xj) 

i=2 



(3.17) 



where the RHS is to be interpreted as the conditional joint sojourn time of a test 
customer Cq in a cyclic tandem of nodes 2,3,... , J, given Gq finds an arrival 
disposition (0 | X 2 ,X 3 , . . . , xj) of other customers. 

Using induction with respect to the number of nodes and the number of 
customers cycling we transform (3.16) into 



E 



K,J 



1=1 



X! Tr^’‘^{xi,X 2 ,... ,xj) 

(xi,X2,... ,Xj)^S{K — l,J) 



( P2O2 yr ( Pj 9 j 

[l-q202j \9j 



(3.18) 



That the expectation in the LHS of (3.18) is expressed as an expectation 
under P^k.j in the RHS resembles the similar property in the continuous time 
setting. (See [86] for details, or [30].) There an invariance property of the joint 
sojourn time distribution under exchanging the underlying measure can be pro- 
ved a priori. ([76], Theorem 3.1.) Here this must be proved as a final step of 
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our proof of theorem 3.11. But the RHS of (3.18), which is (3.12) for i = 2, is a 
symmetric function by the lemma 7.3 of Appendix 7.2. The proof is completed. Q 



Remark 3.14 The proof of theorem 3.11 is performed by induction on the length 
of the cycle and the number of customers. We considered the cycle built of an 
initial node connected to a smaller residual cycle with less customers cycling, 
where the induction hypothesis applies. Insofar the proof is standard, mimicing 
the continuous time analogue, see [10], [76]. Kelly and Pollett showed even more: 
In the continuous time setting the splitting of the cycle for the induction step 
is possible between every pair of nodes j and j + 1, j € {1, 2, . . . , J — 1} - the 
induction step is always the same ! The main difficulty that arises in the discrete 
time system is to justify this splitting. Directly carrying over the arguments from 
[76] is not possible, because of the dependence of the disposition distribution for 
the other customers on the node where the customer jumps (theorem 3.9 and 
remark 3.10). 

Following the ideas and the lines of the proof in [76], we would obtain results 
on the distribution of {Si, . . . , Sj) for a cycling customer in systems governed by 
measures P^k.j ,j = 2, . . . ,J, but not the required result for a system governed 



by P^K.j. 

In continuous time it can be proved a priori (without computing explicit 



( ^ 

distributions !) that for the joint distributions P^k] 



■,Sj) _ 



=: P 



(S. 



( 1 ) 



...S«) 



P^Kj ’ " ’ holds, j = 2, . . . , J (we use the notation introduced above for simi- 

lar quantities) . This is Theorem 3.1 [76] and is used in the sojourn time Theorem 
6.1 (p.650) there. For further detailes concerning these structural properties of 
continuous time network processes see [86] or [35[. 



Following the remark 3.14, our theorem 3.9 suggests that a formal analogue of 
Theorem 3.1 of [76] should not hold in discrete time. The surprising conclusion 
from theorem 3.11 and corollary 3.12 is that in case of sojourn time distributions 
an analogue of the symmetry properties of continuous time systems derived in 
Theorem 3.1 of [76] does hold in discrete time. Indeed: Similarly to the last step 
in the proof of Theorem 3.11 we conclude from Corollary 3.12 and Lemma 7.3 
the following result. 



Corollary 3.15 Let Co commence at time 0 a cycle starting at any node i € 
{1,... ,J}, seeing at this time instant the other customers distributed accor- 
ding Then the joint distribution of Cq’s successive sojourn times vector 

{Si, . . . , Sj) during this cycle does not depend on the node i, where the cycle is 
started. 

As a by-product of Theorem 3.11 and Corollary 3.15 we have a result on the 
distribution of cycle times ( = sum of successive sojourn times) which is the 
end-to-end-delay e.g. in a transmission line under window flow control for a 
system in heavy traffic (see [110] and [111]). A direct proof of different character 
for the result on the cycle time distribution is given in [26]. 
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Corollary 3.16 (End— to— end— delay) In the setting of Corollary 3.12 the cy- 
cle time distribution of Cq starting at node i is given by its generating function 



E 






(3.19) 



(xi,...,xj)eS{K-l,J) (i=i 

xi j r / 1 \ vio.xj) 



0\<l, i=l,...,J. 



03 



e 



1 - qj9 



This distribution does not depend on the node where the cycle starts. 



The results of Theorem 3.11 and Corollary 3.15 provide us with the full infor- 
mation about the distribution of the vector of sojourn times. To consider only 
parts of the cycle is simply to compute marginal distributions of any order. Es- 
pecially moments and covariances can be computed explicitly. Explicit results 
on partial-cycle times are given in [26], section 4. Similar results for joint sojourn 
time distributions can be proved similarly. 



It remains to prove Lemma 3.13. This is indeed the core of our analysis be- 
cause it elaborates in detail on the structure put on our system by the discrete 
time scale. It provides us with a substitute (of completely different nature) of 
the mentioned Theorem 3.1 in [76]. For more details see [29]. 

Proof of Lemma 3.13: The skeleton of the proof is as follows: 

We show that a system of quasi-first-entrance-equations ((3.21) below) has 
nearly a product form solution. The combinatorial complexity of the system 
(due to the appearance of multiple events in the running system) prevents us 
from directly solving this system of equations. Instead in the course of an in- 
ductive procedure, we identify certain substructures which allow a probabilistic 
interpretation in terms of related time reversed systems. Applying the operation 
of time reversal to these systems we are able to transform the original equations 
into a form amenable to a solution. 

In our proof of Lemma 3.13 we will not elaborate on the pathwise time rever- 
sed joint queue length process A, as was done in the continuous time setting 
by e.g. [10] or [86]. Our intuitive arguments evoking time reversed systems of 
different population sizes only describe (from Proposition 3.8) which sums are 
to be balanced, using 

Ti^’\x) ■ p{x, y) = TT^'^y) ■ p{y, x),x,y £ S{k, J), 

where p{-, •) is the transition kernel of X, and p{-, •) that of X. We therefore are 
able to avoid arguing with (stationary) probabilities in a non-stationary system 
- the latter turns into a non-homogeneous Markov system under time reversal. 

A second point why we could not start with considering the system at a 
departure instant from node 1 and then looking forward and backward in times 
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is the dependence of the arrival distribution on the specific arrival node. So we 
cannot prove a fortiori that the distribution of (S'i.S' 2 , . . . , Sj) is the same under 
any P^. . 

Our main work is therefore a careful exposition of the equations concerning 
subsystems, which always occur in connection with some nuisance terms that 
have to be extracted. 

For notational convenience we abbreviate P := P k,j. We have for 

'^1 

{xi,X 2 , X 3 , . . . , xj) G S{K — 1, J) and t>l 

P{Si = t, Z{Si) = (a;i, 0 I X 2 , X 3 , . . . , xj)) (3.20) 

= ^ P{Si > t - l,Z{t - 1) = y) ■ p^[y,{xi,0 \ X 2 ,X 3 ,. . . ,xj)] 

y(^s{Co) 

= P{Z{t-l) = {yi\0,y2,y3,--- ,yj) 

ivi\o,v 2 ,v 3 ,--- ,vj)eS{Co) 

■P^[{yi I 0,y2,?/3,--- ,yj),{xi,0 I X 2 ,X 3 ,... ,Xj)]. 

In a first step we compute these transient state probabilities. It is possible to 
reduce the sojourn time problem for S\ to determining the transient state pro- 
babilities of Z . We may restrict our attention on Z' s development conditioned 
on being in 

S\{Co) = {{xi \ xi,X 2 ,. ■ ■ ,xj) : Xi + Xi + X 2 + ■ . ■ + xj = K -1} C S'(C'o). 
Denote for x G 5'i(C'o) 



f[x;O]:=J^0Pp(Z(t)=x), | 0 |< 1. 

t=o 

These generating functions are uniquely defined by the following set of quasi- 
first-entrance-equations. 

For x= {xi\ xi,X 2 , ... ,xj) G S'i(Co) 

f[x]0]-Tr’^'\xi,X2,... ,xj)-5{xi,tS)=e- ^ f[y,e]-p^[y,x\. (3.21) 

y6Si(Co) 

(i5(-, •) is Kronecker’s Delta.) We shall prove that the solution of (3.21) is 



/[(ii I xi,X 2 , ■ ■ . ,xj); e] 

= T^l’\xi+ Xi,X2,. . ■ ,Xj) 



PiO 



1 - qi9 

{xi,X 2 ,... ,xj) G S{K -l-xi,J), 



1 

l-qi9' 

\< 1 , 



(3.22) 



Exploiting the form of in (3.10) of Theorem 3.9 we see that the solution of 
(3.21) has nearly a product form. (3.22) will be proved by induction on x\. 
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Let us first consider p^[-, ■] in detail. For {xi \ Xi,X 2 , . . . , xj) =: x let A{x) = 
{j & {1, . . . , J} : Xj > 0} be the set of busy nodes, where other customers (not 
Cq) are in service. Then a transition of Z on S'i(C'o) is uniquely determined by 
the set B C A{x) of those nodes where the service of customers expires. 

For any x £ S'i(C'o) and any B C A(x) we define y := Hb{x) G S'i(C'o) to 
be the successor state of x obtained by transfering the customers in service at 
nodes in B to the next node. This happens with probability 



P^\x.Hb{x)\ 




n 

jeA(x)-B ) 



(3.23) 



Here the last factor counts for the case that Cq is in service at node 1, but is not 
allowed to leave that node, because Z should stay in S'! (Co). Now for = 0 
inserting (3.22) into (3.21) yields 




•P^[(0 I yi,V2,--- ,yj ),{0 I xi,X2,... ,xj)]. 



Inserting (3.23) into (3.24) yields for a; = (0 | xi, X 2 , . . . ,xj) 




For xi = 0 the RHS is 




3BCA(y):Hsiv) = x,J^B 



n • ( n 

yes / \j(xA(y)-B J 
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E - 

Ql 

y = (0il,y2,-'- -yj)eSi(Co) 
^BCA(y):H^(y)=x,J^B,ieB 





• f n pjV f n 

\jeB J \j(zA{y)-B J 

= qi- E ,yj)-G{K-i,j) 

y=(0\yi,y2^--- ,yj)^Si(CQ), 

3BCA(y)-.HB(y)=x 

■p[{yi,y2,--- ,yj),{0,x2,... ,xj)]. 



Cancelling the common factor qi, on the RHS we find the non-normalized equi- 
librium probability (in a cycle with J nodes and K — I customers) that a 1-step 
transition leads to (0, X 2 , • ■ • , xj), which is just X 2 , ■ • ■ , xj). For xi > 0 

(noticing > 0 !) (3.25) reads 




3BCA(y):Hs(y) = x,JiB 



(3.26) 



•<7i • 




n 



\.jeA{y)-B 



Cancelling in (3.26) the common factor gi, we find on the RHS the non-normalized 
steady-state probability (in a cycle with J nodes and K — 1 customers) that 
a 1-step transition which does not show a departure from node J to node 1 leads 
to (xi,X 2 ,-- - ,xj). Considering the time reversal of that system, we see that 
this is just the probability of a 1-step transition from {xi,X 2 , ■ ■ ■ ,xj) without 
departure from node 1. This is the LHS of (3.26). 

Our second step is inserting (3.22) into (3.21) for xi = 1. This yields for 
X = (1 I Xi,X2, ... ,Xj) & Si(Co) 




/^y(o,.d p,0 1 

KqjJ \PjJ j ^-qi& ^-qiO 



(3.27) 



E 

v={vi\vi,V2,... .yj)eSi(Co) 
PiO 1 

) l-qiO 





1 - qiO 



■p^[{yi I yi,y2,--. ,yj),{i \ xi,x2,... ,xj)]. 
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For xi = 0 we have in (3.27) 

J r / 1 \ v(o,xj) 



<?i 



n 



PU “UV®/ 






= »■ E 

y = (0\0,y2,^.^ ,yj)GSi(Co) j^2 I 
3BCA(y):H^(y)=x,JGB 



I Pio 

pjj j I - 91^ 



Pi 



(3.28) 



\jeB 



n I ■ 



+0' 



E 






y = (0|l,y2.-- .yj)eSi(Co) V^^iy 

3BCA(y):Hs(y) = ®,l,JeB 



ft 



\jeB 



n 

\j<^A{y)-B 



+e 



(I|0,y2,... ,yj)eSi(Co) 
3BCA(y):Bs(y) = ®,J^B 



E 



PiO 

1 - glp 



n I ■ I n I ■ «i+ 

I^J6B / \j(=A(y)-B 




Now the first and the second summand of the RHS of (3.28) are qi6 ■ times 
the non-normalized equilibrium probability (in a J-node cycle with K — 1 custo- 
mers) that state (1, X2 , . ■ • , xj) G S{K — 1, J) is reached by at least a customer’s 
movement from node J to node 1. Considering the time reversal of that cycle we 
obtain for this sum 



qiO ■ 
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Pi 



J 
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/ 2^ \v{o,xj) 
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The third and the fourth summand of the RHS of (3.28) are 9^qi/{l — qi9) 
times the non-normalized equilibrium probability (in a system with J nodes and 
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K — 2 customers) that state (0, a;2, X3, . . . ,xj) € S{K — 2, J) is reached by 1-step 
transitions. From the equilibrium equation in that system this is 



0^4 

1 - qi0 



,/ 

n 



/ 2^ \ U(0,xj) 

Ui/ 




Summing up the RHS of (3.28) therefore yields 



^ ^ TT 

I -qi0 Pi 



/ 2^ \ v(o,xj) 

KQjJ 




which is the LHS of (3.28). 

For xi > 0 we have in (3.27) (recall xi = 1): 
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/ 2^ \ v[0,Xj) 

\<lj) 
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1 - qi0 



(3.29) 
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y = (0|xi,y2.--- ^yj)^Si(CQ) 
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/ \j€A{y)-B-{l} J 



+ 0 - 9i ■ 

y = (0|xi+l,y2.--- >yj)^Si(CQ) 
3BCA(y):Hs(y) = x,l,JeB 
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\jeA{y)-B 



+ 0 - 91- 

y = (l|xi,y2---- >yj)eSi(Co) 

^BCA{y):HB(y)=x,l,J^B 









3BCA(y):HQ{y) = x,l€B,J^B 
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Here the first and the second summand of the RHS is qid ■ (^ 7 ) times the 

non-normalized equilibrium probability (in a J-node cycle with K — 1 — x\ cu- 
stomers cycling) that (l,a; 2 , . • . ,a;j) G S{K — 1 — x\, J) is reached by (at least) 
a customer’s movement from node J to node 1. Considering the time reversal of 
that system we obtain for this sum 



Pi 



^1 -eq,-- 



9i 






■Pi- 



The third and the fourth summand of the RHS of (3.29) are (P’qfjlX — q\0) 
times the non-normalized equilibrium probability (in a J-node cycle with K — 
2 customers cycling) that state {x\,X 2 ,... ,xj) G S{K — 2,J) is reached by 
transitions where departures from J are forbidden. Considering the time reversal 
of that system this equals the non-normalized equilibrium probability that state 
{xi,X 2 , ■ . . ,xj) G S{K — 2, J) is left by transitions without the service at node 
1 expiring, i.e., 



. i fn V . tt I (r 

l-qi0 qi\pij \Pj 

Summing up the RHS of (3.29) yields the LHS. 



• 91 - 



Let us assume that we have proved (3.22) for all f[y, 0],y = {yi \ yi,y 2 , - ■ ■ , Vj) 
with 0 < yi < ii — 1, 2 < xi < K For induction we have to prove (3.22) for 
all /[(ii I xi,X 2 ,... ,xj)-,0\. 

Inserting (3.22) into (3.21) this reads 



Xi-\-X\ J 

n 

i =2 



\ a(o,xj) 

Qj) 



Si 

Pi. 

Vl+Vl J 



Pi0 1 

l-qi9j l-qiO 

v{0,Vj) 



/„ \!/i+yi /I \v(o,vj) / \V3\ 

E (I) n Gr (3- 

(yi|yi.y 2 .....yj)eSi(Co) j=2 \ 2 \Pj / ] 

Pi0 1 



30) 



l-qi0j l-qi0 
For xi = 0 , i.e., x = (ii | 0, X 2 , ■ . . , xj), this is 



P [{yi I 2/1, 2/2,- , 2 /j),(ii I xi,X 2 ,... ,a;j)]. 




3BCA(y):HB(y) = x,J€B 



Pi0 

1 - qi0 



X-]_ — l 




n 




46 



Chapter 3. Closed Cycles of State Dependent Bernoulli Servers 



y = (xi-l\l,y2,--- ,yj)GSi(Co) 
3BCA(y):H^(y) = x,l,J€B 
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y = (xi\l,y2,... ,yj)e5i(Co) 
^BCA(y):H^(y)=x,J^B,l€B 
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Now the first and second summand of the RHS of (3.31) are Qq\ •(!)") 

times the non-normalized equilibrium probability that in a cycle of 

J nodes with K — x\ customers cycling state (1, X 2 , • ■ • , xj) G S{K — x\,J) is 
reached by (at least) a customer’s movement from node J to node 1. 
Considering the time reversal of that cycle we obtain for this sum 
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1 - qiO 



1 f qi 



qi \Pi 



, \£i — 1 

The third and the fourth summand of the RHS of (3.31) are (P'qf ’ ( ^7 j 

( \£i — 1 

13 ^ j 'T^qTe non-normalized equilibrium probability (in a J-node 

cycle with K — x\ customers cycling) that state (0, X 2 , x ^, . . . , xj) G S{K — x\, J) 
is reached by transitions where departures from node J are forbidden. Considering 
the time reversal of that system we obtain for this sum 



9\l ■ ( ^ 
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Summing up the RHS yields the LHS of (3.31). 
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For X = (xi I Xi,X 2 , . ■ . , xj) with xi > 0 we obtain 
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Here the first and the second summand of (3.32) are ( ^ ) ’ ( ) 

times the non-normalized equilibrium probability (in a cycle of J nodes with 
K — xi — xi customers cycling) that {1,X2, .. . ,xj) & S{K — xi — xi, J) is reached 
by (at least) a customer’s movement from node J to node 1. Considering the time 
reversal of that system we obtain for this sum 
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The third and the fourth summand of (3.32) are 9q\ ■ ^ 1 -)% ') times 

the non-normalized equilibrium probability (in a J-node cycle with K — xi — 1 
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customers cycling) that state {xi,X 2 , ■ ■ ■ ,xj) € S{K — x\ — 1, J) is reached by 
1-step transitions with customer movements from J to 1 forbidden. Considering 
the time reversal of that system we obtain for this sum 



9qi ■ 
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J 

n 



/ I \ v(0,Xj) 

\<ljJ 




• 91- 



Collecting both sums yields the LHS of (3.32). 



We therefore have proved (3.22). Applying now (3.20) yields 
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(3.33) 
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(Note that from the definition 1 ^ A{y). !{•} denotes indicator functions.) 



For xi = 0 the RHS of (3.33) is 
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(3.34) 



This is pi0/(l — <7i0) times the non-normalized equilibrium probability (in a cycle 
of nodes 2, 3, . . . , J with K — 1 customers cycling) that state {x 2 ,X 3 , . . . , xj) is 
reached with departures from node J forbidden. Considering the time reversal of 
that system, we see that this is the non-normalized probability of a 1-step tran- 
sition from (x 2 ,X 3 , . . . ,xj) with departures from 2 to J forbidden. This yields 



(3.34) 
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which is for xi = 0 the RHS of (3.15). 
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For a;i > 0 the RHS of (3.33) is 




Cncelling (i) ■ (jj) W = (i) (fj) 

the first sum in the squared brackets of (3.35) we see that this is ( ^ ) times 



V(0,xj-1) 



. xj — 1 



■ qj in 

Xi — 1 



the non-normalized equilihrium probability (in a cycle of nodes 2,3,... , J with 
K — 1 — x\ customers cycling) that state {x 2 ,X 3 , . . . , xj) € S{K — 1 — xi, J — 1) 
is reached by a 1-step transition where departures from J to 2 are forbidden. 
Considering the time reversal of that system this turns out to be 





■ 92 



The second sum in the squared bracket of (3.35) is ‘ times the non- 

normalized equilibrium probability (in a cycle of nodes 2, 3, . . . , J with K —1 — xi 
customers cycling) that state (x 2 , X 3 . . . ., xj) G S{K — 1 — xi, J — 1) is reached 
by 1-step transitions where departures from J to 2 are forbidden. Considering 
the time reversal of that system this turns out to be 
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Collecting now all the terms of (3.35) yields for the case xi > 0 the RHS of 
(3.15). 

We have proved Lemma 3.13. 



G 
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3.4 Computational Algorithms for 

Closed Cycles of State Independent 
Bernoulli Servers 

It is well known that in performance analysis of continuous time systems to 
compute norming constants similar to those appearing in theorem 3.2 poses 
considerable difficulties. Several algorithms are developed for efficiently evalua- 
ting norming constants, steady state probabilities, and further quantities derived 
from this, which describe the quality of service provided by networks. In [13] clas- 
sical results on algorithms to compute performance indices for closed networks 
based on norming constants and based on Mean Value Analysis (MVA) are de- 
scribed. A detailed analysis is presented in [5] of convolution algorithm (norming 
constants), MVA, and the more recent REGAL method, and additionally of ap- 
proximation algorithms for product form networks as well as for non product 
form networks based on the concepts provided by these prototype algorithms. 
For a recent discussion and a short survey, including especially approximation 
procedures ( which can be developed in the framework dealt with here in paral- 
lel), see [53] 

Special algorithms for discrete time systems with finite capacity, which are with 
respect to some properties equivalent to closed networks, are developed in [125]. 



The structure of these algorithms point out the way to compute the inte- 
resting quantities here as well. We sketch in this section how to do this. A first 
observation is based on theorem 3.2 and proposition 3.5: While in continuous 
time models the norming constants in the steady state and in the arrival pro- 
babilities are of the same structure, we have to apply different computational 
schemes here. Clearly this holds for the multichain case (section 3.2) as well. For 
a concise presentation we restrict ourself to the unichain case, and assume the 
service probabilities to be state independent. 



Proposition 3.17 (Norming constants) (a) For the steady state distribution 
(3.2) in theorem 3.2 (with state independent service probabilities) the norming 
constant in a system with K customers cycling in J nodes is 



G{K, J) 



E n 

ni + --- + nj = K 





ViO.rij) 



K >1,J>1. 



(b) The norming constant for the arrival probabilities (3.8) in proposition 3.5 
seen by a type m-customer on his arrival at node i in a system with K customers 
cycling in J nodes is 
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These norming constants are type independent. We set 

G,{K,J):=G,^m{K,J), mGM. 

The following is an analogue of Buzen’s algorithm ([17]). 

Proposition 3.18 (Buzen’s algorithm) For K > 1, J > 1 and pj G (0,1), 
dj = ^-Pj,3 = I,---, J let 

G{K,J)= Y. ri 
1=1 

Then the following recursion holds: 

•1 1 

G(1,J) = V-, J>1, 

G(if,l)=f^') i^>l, 

\pij qi 

G(K,J) = G(K,J-1)+'^G(K -1,J) + G(K 

Pj 

K>2,J>2. (3.36) 

Note that the computation of (3.36) depends on the prescribed numbering 
of the nodes. Renumbering the nodes leads to different paths for the algorithm. 




The norming constant for the arrival probabilities will be computed for any 
customer arriving at node 1. It does not depend on the type of the arrival. 
Formally for arrivals at other nodes an algorithm similar to the following applies. 
But to make this distinction is not necessary: From lemma 7.3 it follows that for 
all j = 1, . . . , J equality Gi{K, J) = Gi{K, J) holds. 



Proposition 3.19 For K > 1, J > 1 and pj G (0, 1), gj = 1 — pj,j = 1, . . . , J 
let 



Gi{K, J) 



E 




/ l \ V(0,nj) 



Then the following recursion holds: 
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Gi{K, J) 



G{K-1,J-1) + 



—Gi{K 






K>3,J>1. 
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For systems in continuous time with state dependent service rates computa- 
tional algorithms are described in [13]. Similar constructions can be proved in 
the discrete time setting along the lines sketched here. Some elementary conse- 
quences of the above algorithms follow. 

Corollary 3.20 For the closed cycle with state independent service probabilities 
in equilibrium (see theorem 3.7) we have: 

(a) The probability for the queue length X\ at node 1 to exceed k G {0, 1, . . . , K} 
is 



P{Xi>k)=(—^ —Gi(K-k,J)G(K,J)-^ 

\PiJ 9i 

(b) The mean steady state queue length if[Xi] at node 1 is 

E[X^\ = -G{K,J)-^Y.{-^ Gi(K-fc,J). 

(c) For j = 1, . . . , J and k >0 we have 

P{Xj >k) = P{Xi >k)( — 

\diPjJ dj 

Note that computing these performance indices needs an interplay of con- 
stants of different type: from time stationary steady states and from customer 
stationary steady states. Such distinction is not necessary in the continuous time 
setting. 




Chapter 4 



Open Tandems of State 
Dependent Bernoulli 
Servers with Different 
Customer Types 



In this chapter we investigate a subclass of open networks of Bernoulli servers 
with simple topology: Series of linear ordered nodes, fed by an external arrival 
stream, i.e. open tandems. These are the analogues of tandems of exponential 
single server queues in continuous time under FCFS-regime. These tandem net- 
works are of importance for many applications: Production lines, transmission 
lines in a telecommunication network, etc. 

The classical results in the present context on steady state behaviour for 
such systems (with state independent Bernoulli input and indistinguishable cu- 
stomers) date back to 1976 - see [65]. Hsu and Burke solved the steady state 
problem by proving time reversibility of the nodes’ local state process in equili- 
brium and then using induction. A similar procedure is not possible in the more 
general case considered here, because we have state dependent arrival processes 
which implies that departure streams are not homogeneous. 

We describe the steady state behaviour of state dependent tandems with diffe- 
rent customer types in section 4.2 and derive mean value performance indices. In 
section 4.3 we compute end-to-end-delay distribution for a customer traversing 
the tandem and the distribution of this customer’s joint sojourn times at the 
different nodes of his itinerary. 

Before presenting these results we describe (following [28]) in section 4.1 how 
these results can be applied to networks with more general topoloy, modeling 
e.g. transmission lines in meshed networks. This widens considerably the appli- 
cability of the seemingly narrow class of linear tandem systems. 
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In section 4.4 we consider an important related model: Re-entrant lines which 
are the models for manufacturing systems with intermediate production control 
and rework stages. So possibly parts have to reenter the same machine more 
than once. According to the observed quality of the production an item on leave 
from a production stage is either released to the next stage (if the quality is 
sufficient high) or immediately sent back to the previous stage for rework. The 
nodes which model the stages of the production process are the state dependent 
feedback Bernoulli servers of section 2.3. We consider both the systems with and 
without capacity constraints, which leads to closed cycles or open tandems of 
feedback queues. 

4.1 The Principle of Adjusted Transfer Rates 

The aim of this section is to develop a simplified model for performance evalua- 
tion of a virtual channel in a meshed network, i.e., a transmission line prescribed 
for a specific connection (see figure 1). 

The analoguous method for modeling linear substructures in general networks 
is well established in the framework of continuous time systems: The principle of 
adjusted transfer rates. This principle turns out to be of even more value in the 
discrete time framework because nonlinear networks in general do not exhibit a 
product form steady state and the equilibrium distributions are up to now not 
available [56]. 

Let us consider a virtual channel in a meshed communication network (figure 
4.1). A virtual channel is a line of successive transmission channels dedicated to 
a sender-receiver pair of nodes for a communication session. Although not ne- 
cessarily a shortest connection such a virtual channel can be seen as a linear 
substructure of the network. The nodes of this prescribed line of interest repre- 
sent the transmission channels; they are numbered 1 through J. Calls of different 
types arrive at node 1 according to a state dependent random process and pass 
the nodes in increasing order. (The details for the dependence of the arrivals on 
the network’s state will be described below.) 

The calls are divided into cells of fixed (equal) length. The cells are trans- 
mitted according to a First-Come-First-Served regime one by one through the 
successive transmission channels. The time for transmitting one cell through a 
channel constitutes the inherent discrete time scale of the system: Transmission 
of a cell needs exactly one time unit. Because it is assumed that the sender at 
node 1 of the virtual channel transmits at most one cell per time unit into the 
transmission line of nodes 1, . . . , J no queues would built up if the line is used 
only by such cells arriving at node 1, which are henceforth called regular cells. 
Delay and queueing are due to the traffic from the rest of the network which 
partly interferes with the regular cells at the nodes of the line. We incorporate 
the effect of this background traffic into the model as follows: 

In a first step all background traffic originating from the rest of the network 
that arives at node j is bundled (figure 4.2) into one stream of background cells 
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Fig. 4.2. The virtual channel with bundled background traffic 



for node j, which interferes here with the regular cells from the virtual channel 
and thereafter leaves the line directly, j = 1, ... ,J. 

Therefore a regular cell on its arrival at node j will possibly find there a 
queue of other regular cells and of cells from the background traffic. The length 
of this queue is random due to the randomness of the arrival process of regular 
cells at node 1 and of the background traffic. From the point of view of regular 
cells they have to share the total capacity of the nodes (one cell per time unit) 
with cells of the background traffic. If the intensity (= mean number of arrivals) 
of the background traffic at node j is G [0, 1), then the capacity of node j 
dedicated to regular cells is Pj := 1 — qj cells per time unit. 

In a second step the load of the background traffic on node j is locally 
incorporated into the model by reducing the capacity of node j by an amount of 
qj to Pj cells per time unit (adjusted transfer rate), and thereafter neglecting the 
rest of the network outside of the virtual channel. This yields a linear network 
of nodes 1, . . . , J with regular cells only (see figure 4.3). 

Our resulting model (see figure 4.4) is therefore a transmission line of nodes 
1 through J, where the capacity of node j is reduced from one cell per time 
unit to Pj cells per time unit, 0 < < 1. This is equivalent to having a mean 

transition time oil/pj > 1 at node j. The randomness of the background traffic is 
incorporated by assuming geometrically distributed transition times with exactly 
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Fig. 4.3. The virtual channel as a line with reduced capacities 



these means. It follows: A (regular) cell in transmission at the beginning of a 
time slot at station j will be completely transmitted at the end of this slot with 
probability Pj, with probability 1 — Pj the transmission will need at least one 
more time unit. Our aim is to develop an analytical framework for the following 
optimization problem: 

Suppose the traffic of interest arrives as a Bernoulli stream of intensity B G 
(0, 1] at station 1. Then find a control 

/3:IV — n — > /3(n), 

which constitutes a state dependent Bernoulli switch at the entrance point of 
the line. To be more specific: If the total load of the line is n (= sum of all queue 
lengths in the line), an arriving cell will be admitted with probability (3{n), with 
probability 1 — (3(n) it will be rejected and will be lost. Consequently the arrival 
probability is h{n) = B ■ fi{n). The control is to be chosen such that 

(a) For a prescribed (small) probability 7 G (0, 1) the loss probability of a 
cell is less than 7; 

(b) For a prescribed (large) probability a G (0, 1) and a critical transmission 
time to the probability that transmission of a cell is performed within time to is 
greater than a. 

(c) The throughput is maximal given constraints (a) and (b). 

This admission control scheme is incorporated in a general model which ad- 
ditionally allows to control locally the transmission capacity adapted to the local 
load. So in our model we have the following control options: 

(i) The probability of terminating at node j a cell’s transmission at the end 
of the present time unit may depend on the actual load rij > 0 of that node 
{queue length at node j), pj = Pj{uj),j = 1, ... ,J, and 

(ii) the probability b G [0, 1] of a new arrival at node 1 at the end of the present 
time unit may depend on the total load n of the system (n = ni -I- • • • -I- nj, the 
total population size of the line), b = b{n), and on the type of the customer as 
will be specified below. 

These control options for discrete time networks were investigated in the case 
of indistinguishable customers (cells) in [31] and include as an extreme case the 
classical window flow control, see [110], or loss systems. Introducing different 
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Fig. 4.4. Transmission line with adjusted state dependent capacities 



customer types (cell types, [28]) turns out to be technically more involved but 
offers a more versatile modeling feature, e.g. for keeping trace of individual cells’ 
behaviour and computing type dependent loss probabilities. 

The principle of adjusted transfer rates in the continuous time framework is 
theoretically investigated by Reise, [110], [111], in connection with closed product 
form networks and especially their Mean Value Analysis (MVA) . He proved that 
the steady state analysis in the reduced system yields the correct results even 
for the general network model. Results for open and mixed networks, especially 
concerning the analysis of delay time distributions can be found in [34] . Applying 
the principle of adjusted transfer rates to these models therefore provides exact 
analytical performance measures in the context of continuous time product form 
networks. In the discrete time setting of single server FCFS nodes a similar result 
allowing general network topology seems to be impossible, because nonlinear 
networks in general exhibit no product form equilibrium. But nevertheless it 
seems to be a reasonable approximation yielding explicit performance quantities 
and explicit measures for the quality of service, which are easily accessible. 



4.2 Steady State and Arrival Theorem 

We use Bernoulli servers as described in section 2.2 as building blocks of an open 
tandem of queues. The node characteristics remain the same as in the previous 
chapters. Customers of different types arrive according to a state dependent Ber- 
noulli process at node 1, are served there according to FCFS, and proceed then 
through the sequence of nodes possibly changing their types, which is determi- 
ned by the regime described in section 2.2. After leaving node J, the customers 
depart from the system. 

We assume that there is only one chain of customers, all customers share the 
same type set M (see section 3.1 and 3.2 for a discussion). The entrance type of 
an arriving customer is chosen according to rules to be given below. If a customer 
of type m G M leaves node j, then this customer’s type is resampled according to 
the probability matrix r(j), his new type is m' G M with probability r(j; m, m'), 
j = l,...,J. 

Regulation of simultaneous events is according to late arrivals and departure 
before arrivals, see [51]. 

The external arrival probabilities depend on the total population of the sy- 
stem and on the type of the arrival, i.e., if at time t G IN there are nj customers 
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present at node j, j = 1, . . . , J, then a new arrival of type m appears in (t, t + 1] 
with probability b{ni + • • • + nj) ■ a{m) G (0, 1). 

Service times and arrival decisions are conditionally independent given the 
actual vector of customer types at the nodes. 

We use the definitions of section 2.2 and section 3.1: M{i) denotes the set of 
possible types which customers may show when staying in node i,i = 1, . . . , J. 
Here M(l) = {m G M : a(m) > 0}, while M(i),i = 2, . . . ,J, is determined by 
solving the equation (3.1) for rj{i; -),i = 2, . . . , J, in the present context and then 
setting M{i) = {m G M : rj{i; m) > 0}. 

A typical state of the system is cc = {x\, . . . ,xj), where Xj = Cj or Xj = 
{xji, . . . ,Xjnj) G M{j)‘^c 1 < rij,j = 1, . . . , J. Xj is called a local state for node 
j with the interpretation given before in section 3.1. These local states allow to 
construct the state space 

S{J) := {{xi,...,xj) : Xj = (xji, . . . ,Xjnj) G M{j)"\nj > 0,j = 1,..., J}, 

where the process X, which desribes the time evolution of the network, is li- 
ving on. Let Xj{t) denote the local state at node j at time t, and X{t) = 
(Xi{t), . . . ,Xj{t)) the joint vector of type sequences at time t. X = (X{t) : t G 
IN) is a discrete time Markov chain with state space S{J) and transition matrix 
p = {p{x,y) : x,y € S{J)). X is irreducible on S{J). 

We prove stabilisation conditions for this tandem system starting from a 
closed cycle which comprises the given nodes and one extra node, which simulates 
the source and the sink, and then let the population size grow to infinity [31]. 

Theorem 4.1 (Steady state) The Markov chain X is ergodic if and only if 



H{J) 



E 

(ni,... ,nj)^]IV'^ 



'v reir c(/r) 



< oo. 



(4.1) 



If this ergodicity condition is fulfilled, then the unique equilibrium distribution of 
X is TT'’ = {tt'’ { x) : X G S{J)) given by 



TT-^{X1, ... ,Xj) 

^ ( (^11 J • ■ • J ^Ini)'; • • • 1 (^Jli • ■ • 7 ^Jnj)) 



(4.2) 



{xi, ... ,xj) & S{J), 






\k^l 



\u:uMh) ) 






where c{h) := 1 — b{h), h G IN. 
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Proof : Consider a closed cycle with K customers with common type set M, 
and nodes 0, 1, 2, . . . , J, where nodes 1, 2, . . . , J are as described in section 3.1 
with state dependent service probabilities Pj(jij) and and type selection matrices 

r{j), I <j < J- 

Node 0 is an extra node simulating the traffic source: Customers present at 
node 0 are all of the same type, say niQ and r{J-,m,mo) = l,m G M. We set 
r(0; Too, m) = a{m) = rj{l; m) for m G M(l), and r(0; m', •) to be any probability 
on M for m' yf mo. 

The service probability at node 0 is po(?^o) = b{^ ~ ^o), ^ < no < K. So, if 
this node 0 is occupied by the total population of size K, then the transmission 
line 1, . . . , J is empty and node 1 observes a Bernoulli arrival stream with pro- 
bability 6(0) for an arrival per time slot. An arriving customer at node 1 will be 
of type m G M with probability a(jn). 

The steady-state distribution of this system (with G{K, the norming 

constant and no the number of customers present at node 0) is by theorem 3.2 



7r^’-^+^(no, (xii, . . . , xi„J; . . . ; {xji, ..., xjnj)) 

( UZ~i'c{K-h) \ 

\nZib{K-h) ) 

(Y\lZo-^^^-Z{h) 
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Letting K — > oo, we have to prove convergence to a finite limit 
lim f n G{K,J+l)~^<oo. 

Vio 

But this can be proved to be equivalent to (4.1). 

Existence of a finite limit implies that for K — > oo the total population 
size in the transmission line 1, . . . , J remains finite with probability 1. So node 
0 is the bottleneck of the system which approaches a state dependent Bernoulli 
source. 0 

Theorem 4.1 opens the way to optimize transmission lines as described in 
section 4.1 using the principle of adjusted transfer rates and the simple but ver- 
satile state dependent arrival process with customers of different types. Allowing 
furthermore b(n) G [0, 1) for some n G IN then theorem 4.1 includes the case 
of loss systems as well, where at a server with one transmission channel and 
L — 1 > 0 buffer places arriving customers are lost when on their arrival the sy- 
stem is full. With suitably restricted state space and adapted norming constant 
formula (4.2) applies again. (See [31], section 3.) 
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Example 4.2 (Control of Bernoulli arrival streams) Consider a state in- 
dependent Bernoulli arrival stream with intensity B G (0, 1] of customers of 
different types (an arrival is of type m G M with probability a{m)), which feeds 
an open tandem of Bernoulli servers as described above. Introduce a Bernoulli 
switch at the entrance point of the network (before node 1): If the total popula- 
tion size of the network is n then an arriving customer is allowed to enter with 
probability /3(n) G (0, 1] and is rejected and lost with probability 1 — /3(n). As- 
suming the usual independence properties of a Bernoulli switch this system fits 
into the class of models where theorem j.l is applicable with b{n) = B ■ (3{n). If 
the arrival process is sufficently thin (l — /3{n) sufficient high) we have ergodicity. 
Therefore such a switch can be incorporated to stabilize the system, and we can 
construct a scheduling regime for optimizing the network. 

Example 4.3 (Open loss systems) The assumption (3{n) G (0, 1] on the ad- 
mission control function /3(-) can be weakend such that (3{n) = 0 holds if n > L 
for some control limit L G IN. This yields the usual loss control for networks if 
we have (3{n) = 1, 0 < n < L. 

Our aim is to investigate an individual customer’s delay behaviour. We the- 
refore need an arrival theorem similar to proposition 3.5. The proof is similar, 
but more involved because of the state dependent arrivals. We omit it therefore. 



Theorem 4.4 (Arrival Theorem) Consider the state process X of the open 
tandem in equilibrium and consider the event 

A{l,m) = { at time 0 a customer of type m arrives at node T\. Then 



... ,xj) = P{X(Q) = {{xi,m),X 2 , . ■ . ,xj\A{l,m)) (4.3) 

= E(X(0) = ((xii,. . . ,a:i„J,m); ( 0 : 21 , . • .,X 2 n.,)-, • ■ • ; {xji, . . . , J|A(1, m)) 
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Hi{J) is the norming constant, which does not depend on the type of the arriving 
customer. 

For i yf 1 similar formulas apply. 



The usual interpretation of is that it describes the distribution of the other 
customers’ disposition in an arrival instant at node i under equilibrium con- 
ditions, the jumping customer is not counted. Remarkable is that this arrival 
distribution has not the form of the equilibrium of the system. In continuous 
time such a statement is true. For a state independent Poisson arrival stream at 
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node 1 this is the celebrated PASTA property (Poisson Arrivals See Time Aver- 
ages) . Another strange observation is that the arrival distributions in discrete 
time depend on the node, where the arrival appears. This is again contrary to 
the continuous time case where the arrival disposition has the same distribution 
for all nodes of the open tandem, [123], [94]. 

Note: If we rescale time, approaching in the limit a continuous time scale, 
our systems transform to open exponential queueing networks: In the limit the 
asymmetry of the arrival distributions disappears and all of them are - at least 
for state independent arrivals - equal to the steady state distribution of the 
network. (Similar remarks apply in the closed cycle case of Proposition 3.5.) As 
we have shown in theorem 3.9 these remarks apply even for closed cycles with 
state independent service rates and equally it does in case of state independent 
arrival and service probabilities for open tandems. 

Some typical results for providing explicit performance values follow. 



Corollary 4.5 (Individual loss probabilities) (a) Control of Bernoulli ar- 
rival streams (Example 4.2): Assume that a Bernoulli arrival process with arrival 
probability B € (0, 1] is controlled by a Bernoulli switch with admission probabi- 
lities j3{n),n G IN. Then the loss probability for an arriving customer of type m 
due to rejection is 



K 



Pl,m{J) — 1 



B 






H{J) c{h) 

: ’ K=0h=0 ^ ’ 



where G{K, J) is the norming constant for the arrival distribution at node 1 for 
a customer in a closed cycle of J nodes (see section 3.3) with K indistinguishable 
customers cycling. (See [31]; Theorem 1.) 

(b) Open loss system (Example 4-3): Assume additionally that the control of 
the Bernoulli-(B) process is of the form 

(3{n) = 1, n < L, /3{n) = 0, n> L. 



Then the loss probability for an arriving customer of type m due to overflow is 



PL,m{d) 



G{L,J) 
H{J) ■ 



Proof : Similar to the proof of Theorem 4.4. We sketch only part (a). 

Let A(l,m) denote the event that at time 0 a customer of type m arrives at 
node 1, and A°(l,m) denote the event that at time 0 a customer of type m is 
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rejected at node 1. We have to compute P{A'^{l,m)\A{l,m). This is 
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In (1) we have used that b{n) = B ■ (3{n) holds. O 

To compute loss probabilities at a single station with finite buffer, single 
deterministic-(l)-server, and a Markovian arrival stream is transformed in [68] to 
compute steady state probabilities in an infinite buffer queue. Similar principles 
can be seen behind the above results on loss probabilities. 



Theorem 4.6 (Throughput of the tandem) In equilibrium the throughput 
of the tandem is 



Th{J) = Hj{J) ■ H{J)-\ 

The throughput of type m customers is a{m) ■ Th{J). 
Proof: The throughput of the line is 

Tr\xi,...,xj)-pj{nj). 



Direct summation yields the result. 0 

This result is somewhat curious: Inspection of the definition of Hj(J) in 
theorem 4.4 leads to the conjecture that the value of the throughput depends 
on the node where it is evaluated, because the Hj{J) appears. But it can be 
shown, that Hj{J) does not depend on j. (See lemma 7.3 in section 7.2 of the 
appendix.) 
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4.3 Delay Time Distribution for Customers 

in an Open Tandem of State Independent 
Bernoulli Servers 



To compute the passage time (end~to-end~delay) distribution for the general 
tandem system of theorem 4.1 with state dependent service times seems to be 
an unsolved problem up to now. In the following we shall present some partial 
results for the case of state independent service rates, which is for applications 
the possibly most important instance. 

We consider a test customer of type m arriving at time 0 at node 1 who finds 
the other customers distributed according to Let (S'!, . . . , Sj) denote the 
vector of this test customer’s successive sojourn times (=waiting time + service 
time) at the nodes during his passage starting at time 0. 

We denote by ^ probability law which governs the evolution of the 

system under this initial condition, and by [•] expectations under P„.j . 

Working under this initial conditions we have the following theorem [31]: 



Theorem 4.7 (Joint sojourn time distribution in a tandem) 

Let (S'1,5'2 ,... ,Sj) denote the vector of the test customer’s successive sojourn 
times at the nodes during his passage through the tandem. The joint distribution 
of {Si, S 2 , • ■ • , Sj) is given by the generating function 
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Proof : The arrival probability for the case of state independent service proba- 
bilities is 
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Conditioning on the arrival disposition of the other customers seen by the arri- 
ving customer we obtain 
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The sum in the waved brackets can be given a specific interpretation: 

Consider a closed cycle as described in section 3.1 with K + \ customers 
cycling, and with a customer of type m, henceforth called Cm, on arrival at 
node 1, seeing the other customers distributed according to the arrival distri- 
bution of proposition 3.5. In case of state independent service probabilities this 
distribution is 
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Now we consider in this virtual closed cyclic system the joint conditional distri- 
bution of Cm’s successive sojourn times during his next cycle, given the arrival 
disposition (xi , . . . , xj) for the other customers and conclude that it is identical 
to the joint conditional distribution of a customer on his passage through the 
open tandem, given that customer observes an arrival disposition (xi, . . . ,xj). 
This is due to the strong Markov property of the state processes for both sy- 
stems, the identical structure of the nodes in the systems, and the overtake-free 
property of the open tandem as well as of the closed cyclic network with respect 
to one cycle of Cm- 

We therefore can reduce the computation of (4.6) to first computing the joint 
sojourn time distributions of Cm in a sequence of closed networks with increasing 
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population size K+1 = 1,2, ... . Using the obvious notation similar to (4.3) and 
(4.6) we have to compute 
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Collecting states in (4.8) according to common joint queue length vectors and 
arguing that the conditional sojourn time distribution does not depend on the 
types of the customers we can apply the result of theorem 3.11 and obtain 
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Inserting this into (4.6) yields (4.4). 

The reader should be cautioned: The tempting conjecture 
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is false. This is the reason why the proofs of (4.9) and (4.4) are difficult. Compare 
the discussion following theorem 3.11. 
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The result of theorem 4.9 states that the joint distribution of the successive 
sojourn times of a customer in equilibrium is distributed like a mixture of multi- 
variate distributions with independent negative binomial marginals. The mixture 
distribution is explicitely given. So the inversion of the transform result (4.6) can 
be performed easily by hand. These remarks apply to the following results as 
well. From (4.4) we obtain the distribution of a customer’s end-to-end~delay 
Si + --- + Sj. 



Corollary 4.8 (End— to— end— delay distribution) For the test customer of 
type m arriving at time 0 at node 1, finding the other customers distributed 
according to the distribution of the end-to-end-delay is given by the gene- 

rating function 

^ Hi(J)-i 




For the case of a state independent Bernoulli arrival process these results boil 
down to simply to evaluate distributions. The most remarkable result in this 
case is the independence of the successive sojourn times of a customer, when 
traversing the tandem [29]. 

Corollary 4.9 (Independent sojourn times) For state independent Bernoulli 
arrivals the joint distribution of {Si, S 2 , • ■ • , Sj) is given by the generating fun- 
ction 
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The individual sojourn times are geometrically distributed with parameter 
j = 1, . . . , J, and independent. 



This result is the analogue of Burke’s and Reich’s results on the indepen- 
dence of a customer’s successive sojourn times in an open exponential tandem 
in continuous time (for a review see [9]). An immediate consequence is that the 
distribution of a customer’s end-to-end-delay in a network in equilibrium can be 
computed directly as a convolution of the single-node-delay distributions, for a 
direct proof see [26]: 




4.4. Re-entrant Lines 



67 



Corollary 4.10 (End— to— end— delay) For the network in equilibrium the 
transition time (end-to-end-delay) of a customer is given by 

E r5)Si+-+Sjl ^ TT ^ . , I 61 |< 1. (4.10) 

A typical example of an adhoc approximation procedure to solve complex 
discrete time network problems is described by Bruneel and Kim [14], Chap- 
ter 4.1.6: The end-to-end delay of a cell on its transmission through an ATM 
network is computed by assuming that the successive single node delays behave 
statistically independent. This results in convolution formulas for the end-to- 
end delay distribution. The result on the end-to-end delay in corollary 4.10 is 
therefore: In case of linear series of state independent Bernoulli servers the as- 
sumption holds and the convolution formula is exact. Clearly, compared with the 
decomposition approximation of Bruneel and Kim, formula (4.10) suffers from 
the fact that the class of networks dealt with is much more narrow. 

The approach of Bruneel and Kim can be viewed as typical for dealing with more 
general cases. Our corollaries 4.9, 4.10 contribute to the discussion in that we 
have identified some fundamental networks where their approximation is exact. 

Similar procedures and results are well known in continuous time networks. 
The decompsosition of the end-to-end-delay into independent sojourn times 
as an approximation procedure is (e.g.) investigated in [64] and termed IFTA 
there (independent flow time analysis). For overtake free paths it is known that 
the IFTA procedures yields exact distributional results. For a discussion see [9], 
sections II. 7 and III.l. 



4.4 Re-entrant Lines 

Re-entrant lines are models for manufacturing systems of high complexity with 
items (parts) flowing through the line which possibly request for different kind 
of service and different amount of work. At control stages in the line after a 
production step the items are controlled and according to the observed quality 
of production either released to the next step in the process or send back to the 
previous process node for rework. Examples for such systems are semiconductor 
manufacturing plants. Typically these production networks show a linear struc- 
ture, which is superimposed by feedback cycles with reentering machines more 
than once. For a short introduction into the modeling of re-entrant lines via 
queueing networks see [90], and the references there. Scheduling of such systems 
is described e.g. in [91]. 

If the actions on all stages are synchronized, then the production line is suitably 
modeled by a discrete time network of queues. A more detailed description may 
be found in examples 12.1 and 12.37 of [18]. The models considered in this sec- 
tion revisit these examples. It should be remarked that the re-entrant systems 
considered here do not meet the full generality which is inherent in the formula- 
tion of re-entrant lines. We only allow immediate return to the same machine. 
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which is necessary for the manufacturing systems with production control, but 
it is not sufficient to model parts visiting machines more than once in course of 
the planned production process. This problem is almost unsolved in the frame- 
work considered here and is part of ongoing research in discrete time stochastic 
networks. 

For the more versatile framework in continuous time which includes such be- 
haviour see the tutorial [90]. For the discrete time networks a first attempt is 
described in section 5.3, and [33], respectively. More recent developments are 
described in section 6.1. Note however that the models in section 6.1 do not 
explicitly model part specific sequencing in the nodes. This can be easily in- 
corporated into the framework presented here by introducing different customer 
types. 

Rework of an item is modeled by immediate feedback of the item into the same 
node. So the feedback nodes of section 2.3 will be suitable models for the stages in 
the production process. For ease of presentation we shall restrict the description 
to the case of indistinguishable customers, i.e. the products which flow through 
the line are homogeneous. 

Our first process model is a system which is assumed to be able to handle only 
a limited number of at K items in parallel. We assume that there is heavy load 
for the system. This means that at every time epoch when an item eventually 
leaves the line, departing successfully without rework from its final stage, a new 
item is fed into the entrance node of the line. Consequently the production line 
is considered as a closed line, i.e. a cycle of nodes with immediate feedback. We 
combine the cyclic queue of section 3.1 with the feedback node structure from 
section 2.3. 

We allow the production capacity of a nodes to be adjusted to the load of that 
node: the service capacity is state dependent. The reliability of the production 
depends on the load of the node, the feedback probability is therefore state 
dependent as well. These modeling demands are met by the Bernoulli server 
with immediate feedback of section 2.3. 

The details: We consider a cycle of J state dependent Bernoulli servers with 
immediate feedback under FCFS as described in section 2.3 with K indistinguis- 
hable customers cycling. A customer in service at node j (where the population 
size is rij) departes from that node with probability pj (jij), leaving behind rij — 1 
customers. He is fed back into the waiting room (to the tail of queue j) with pro- 
bability rj(rij). If he was the only customer present he will obtain immediately 
a further service, otherwise he will join the tail of the queue. With probability 
1 — r(rij) he will leave the node and proceed to the next node j -I- 1 of the system 
(J -I- 1 := 1). The decision whether to complete the actual service at node j 
and whether to leave or to reenter the node is made independently of anything 
else in the history of the system given the actual queue length of that node. The 
regulation of customer movements in case of multiple events is: Departure before 
arrival for a joint arrival and departure (D/A) and feedback before arrival for a 
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joint feedback and arrival event (F/A). This regulation scheme synchronizes the 
movements of customers all over the system. 

The evolution of the system will be described by a multivariate discrete time 
stochastic process X := (X{t) : t G IN) as follows: 

Let Xj(t) denote the queue length (customers in service + customers waiting) 
at node j at time t. Then X{t) = (Xi{t), . . . ,Xj{t)) is the joint queue length 
process on state space 

S{K, J) := {(m , . . . ,nj) G N'^ : m -\ h nj = K}, 

which is sufficient for X being Markov, irreducuble on S{K,J), aperiodic, and 
positive recurrent with unique limiting and stationary distribution. 



Theorem 4.11 (Steady state of the cycle of feedback queues) 

Let X = {Xf : t G IN) denote the joint queue length process of the cycle of state 
dependent Bernoulli servers with immediate feedback. The unique stationary and 
limiting distribution for X is {rii , . . . , nj) : (ni, . . . , nj) G S{K, J)) 

with 



7r^’-^(ni,...,nj) 



TT UhLi^i<ljih) +Pj{h)rj{h)) 

fA irHUMh){l-r,{h)) 



G{K, J)-\ 



(m,...,nj) G S{K,J), 



(4.11) 



where G{K, J) is the norming constant. 

Similar to proposition 3.3 we can identify easily a system which is described by 
the time reversal of X. 



Proposition 4.12 (Time Reversed Chain) Denote by X = (X{t) : t G Z) 
the stationary continuation of X under on time axis Z as well. Then the 
time reversal of X 

X = (X{t) := X{-t) :tGZ), 

describes a closed cycle of state-dependent single server nodes with immediate 
feedback. The node characteristics are the same as those of the original sy- 
stem but with K customers cycling in the reversed direction. For state n = 
(ni, . . . , nj) G S{K, J) of X the local states nj denote local queue lengths of the 
nodes. 

Proof of theorem 4.11 and proposition 4.12: Let p = {p{m, n) : m,n G S{K, J)) 
denote the transition matrix of X and p = (p{m,n) : m,n G S{K,J)) the 
transition matrix of X. For any m, n G S{K, J) we have to show (see proposition 
7.2 in the appendix.) 



{m)p{m,n) = {n)p{n,m). 



(4.12) 
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Let for m = (mi, . . . ,mj) £ S{K; J) denote A{m) := {j € {1, . . . , J} : m^ > 0} 
the set of busy nodes when the network is in state m. One-step successor states 
n = (rii, . . . , nj) € S{K, J) of m, n yf m, can be determined as follows and are 
selected according to the following rules and probabilities: 

Chose some B C A{x),B ^ <j), B ^ {1, . . . , J}, with probability 

jeB j^A{x)-B 

At nodes in a service will expire at the end of the present time slot and the 

customer will not return to node j but immediately proceed to node j + 1 . Denote 

the successor of m obtained in this way by n. It follows 

( mj + 1, if j i B, j -l£ B 

rij = <1 - 1, if j £ B, j -1^ B 

[mj, if {j£B, j-l£B) or {j i B, j-l(^B), 

for j = 1, . . . , J. 

For B C A{x),B ^ <j), B ^ {1, . . . , J}, define 
E{B) = {j G {1, . . . , J} : j G j - 1 ^ B}, {the END of B) 
and 

E{B) = {j£{l,...,J}:j-l£B,j^ B}, {m FRONT of B). 

Note that for each pair M ^ n oi successor states there exists exactly one 
nonempty set B C A{m) such that by departing of customers from exactly the 
nodes in B results in a transition from m to n, and vice versa. Then (4.12) reads 

TT I\hii^{(l3{h)+Pj{h)rj{h)) 

• n ~ • n +pj{mj)rj{mj)) 

jeB j^A{x)-B 

TT nrii(gj(^) +pjWrj{h)) -pj- 



n 

..,J}-E(B)-F{B)) 



Uhii \<l3ih)+Pj{h)rj{h)) 



• n Pji^j + + ^)) ■ n Pji^j)i^ 

jeF(B) jeB-E{B) 

■ n - 1) 

jeE{B) 



n 



{qj{mj) +pj{rrij)rj{mj)) 



j€A{x)-B-F(B) 






This can be checked directly. 



G 
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Next we consider an open re-entrant line, i.e., an open tandem similar to the 
models in section 4.2 with nodes of Bernoulli servers with immediate feedback. 
The details of the system are: 

The node structure and the feedback mechanism is the same as before in the 
closed cycle: state dependent service probabilities and feedback probabilities. 
The arrival probabilities for the (undistinguishable) customers are b(n) G (0, 1) 
if the total population size of the system is n. Similar to the reasoning before 
theorem 4.11 we conclude: The evolution of the system can be described by a 
multivariate discrete time Markov chain X := (X{t) : t G IN) as follows: 

Xj{t) is the queue length (customers in service + customers waiting) at 
node j at time t, X{t) = (Xi(t), . . . ,Xj{t)) is the joint queue length process, 
irreducuble on state space IN"^ , and aperiodic. If X is positive recurrent we obtain 
a unique limiting and stationary distribution, which provides us with conditions 
for stabilizing the re-entrant line. 



Theorem 4.13 (Steady state of the tandem of feedback queues) 

X = {Xt : t G IN), the joint queue length process of the open tandem of state 
dependent Bernoulli servers with immediate feedback is positive recurrent, hence 
ergodic, if and only if 



H{J) := 



^ ^ U:L~i\<lAh) +Pjih)r,ih)) 

uiiV'^^^cih) /J miP^(h)a-rm 



< oo. 
(4.13) 



If X is ergodic, its unique stationary and limiting distribution is 
TT'^ = (7T‘^(ni, . . . , nj) : (ni, . . . , nj) G dN"^) with 

7T“'(ni, . . . ,nj) (4.14) 

UT=o"^^^~^Kh) ^ +Mh)r,(h)) , 

uT=V^^^c{h) uZiP^ih)a-rm ■ ^ ^ ’ 

{m,...,nj) G IN-^, (4.15) 

where H{J) is the norming constant. 

The proof can be performed simililarly to that of theorem 4.1. An extra node 
without feedback is introduced which simulates the state dependent Bernoulli 
source and then the population size is increased to infinity. 

The proof is easier for the case of state independent arrival probabilities. Then 
it can be shown that the single feedback node of corollary 2.17 in equilibrium 
is reversible according to the proof of Hsu and Burke [65] and quasi reversible 
according to definition 12.6 of Chao, Miyazawa, and Pinedo [18]. Note however, 
that the departure stream leaving the server and including the customers to be 
fed back is not a Bernoulli process. Only the departure process of customers 
leaving the node is Bernoulli. 
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It follows that the nodes can be coupled directly to a tandem with product form 
steady state. 



Theorem 4.14 (Tandem of feedback queues with Bernoulli arrivals) 

Let X = (Xt : t G IN) be the joint queue length process of the open tandem of 
state dependent Bernoulli servers with immediate feedback, fed by a state inde- 
pendent Bernoulli{b) process. X is positive recurrent, hence ergodic if and only 

if 



H{J) := 



E 



^max(niH j — 1,0) 

hnj 



TT iThLi^QjW+Pjihyjih)) 

U:UPAh){l-rAh)) 

(4.16) 



If X is ergodic, the unique stationary and limiting distribution is 
TT-’ = (7T'^(ni, . . . , nj) : (ni, . . . , nj) G JN"^) with 

7r-^(ni, . . . ,nj) (4.17) 

0 ) J llll-\q^(h)+p,{h)r,{h)) , 

c"i+-+"-' 1^1 UhLiPjWi^-rj{h)) 

(m,...,nj) G (4.18) 

where H{J) is the norming constant. 

Remark 4.15 (Entrance control and loss systems) Similar to example j.2 
the result of theorem j.l3 can be generalized by redefining &(•) to include the 
case of an open re-entrant line with entrance control. Especially the analogue of 
example j.3 then yields a re-entrant line which has a maximal total capacity. The 
heavy traffic assumption of theorem j.ll is not necessary for this modification. 




Chapter 5 



Networks with Doubly 
Stochastic and Geometrical 
Servers 



The doubly stochastic server was introduced by Schassberger [117] as a discrete 
time analogue of Kelly’s symmetric server [75]. The latter is a generalization 
and unification of the nodes which are used to build the BCMP networks in 
continuous time [4]: Nodes with processor sharing (PS) or Last-Come-First- 
Served-preemptive resume (LCFS-preemptive resume) discipline or infinite ser- 
vers. Baskett, Chandy, Muntz, and Palacios showed that customers may request 
at these nodes for type dependent non exponential service times and nevertheless 
a generic product form steady state is found. 

The exponential single servers under FCFS which are further possible buil- 
ding blocks of the BCMP networks are generalized by Kelly as well to include 
general exponential nodes'. Non symmetric servers with customer type indepen- 
dent exponential service request. The discrete time analogue of these nodes are 
the geometrical nodes to be described below. 

Kelly’s networks are a generalisation of the BCMP networks, because he re- 
moved the restriction to only PS, LCFS-preemptive resume, infinite server, and 
exponential FCFS regimes for the nodes by introducing the general exponential 
and symmetric servers. For these networks the steady state probabilities can be 
explicitly given in simple terms as in the BCMP case and the main performance 
quantities can be computed as well. An appealing property is that the first order 
mean values of the relevant performance measures are insensitive: They remain 
invariant under variation of the customers’ service time distribution at symme- 
tric servers as long as the mean service time remains invariant. 

We shall present in this chapter a class of discrete time networks with gene- 
ral network topology which resemble the BCMP and Kelly networks and sketch 
some of their properties. The counterpart to the symmetric server with non ex- 
ponential service time request is doubly stochastic server described in section 5.1, 

H. Daduna: Queueing Networks with Discrete Time Scale, LNCS 2046, pp. 73-jl03j2001. 

© Springer- Verlag Berlin Heidelberg 2001 
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the conterpart of the exponential (multiserver) node is the geometrical server in 
section 5.2. We describe their steady state behaviour, which is of an internal pro- 
duct form for the nodes. Open networks with doubly stochastic and geometrical 
nodes and deterministic routing of customers are described in section 5.3, the 
steady state is presented without proof in section 5.4, it is of external product 
form over the nodes of the network. In section 5.5 we derive explicit closed form 
expressions for important performance measures of the network. The parallel 
closed network case is dealt with in section 5.6, including examples for compu- 
tational algorithms. 

In section 5.7 we specialize the network’s topology to the case of open tandems. 
It is shown that the rules for regulation of simultaneous events, imposed on the 
network in the general case, can be weakened in this case considerably for an 
important subclass of nodes. 



5.1 Description of the Doubly Stochastic Server 

We consider in this section a single node which is fed by a state dependent arrival 
stream of customers of types m G M, M being a countable set of types (not 
containing natural numbers for making the later state description unambiguous) . 

The node consists of an unlimited sequence of service and waiting positions 
1,2,3, . . . which is controlled according to the shift-protocoHWhenever there are 
n customers present, n > 1, they occupy positions 1, . . . ,n. If the customer in 
position i G {1, . . . , n} departs from the node then the gap is closed by shifting 
the customers previously on positions i + 1, . . . ,n one step down into positi- 
ons i, . . . , n — 1, leaving their internal order invariant. Likewise if an additional 
customer is inserted into position i G {!,..., n}, the customers previously on 
positions i, ... ,n are shifted one step up into positions t-|-l,...,n-|-l, leaving 
their internal order invariant. (If n = 0, the node is empty.) 

Having n > 0 customers present at the node service is provided to those 
customers staying on positions l,...,C(n), where C'(n) > 0 is a node speci- 
fic service parameter. We then call positions 1, . . . ,C(n) busy, while positions 
C(n) + 1,. . . ,n are said to be idle. (We set C(0) := 0.) 

Customers entering the node request for a certain amount of service time 
which will be provided to them according to the service disciplin (to be described 
below) of the node. 

If at time t G IN there are n customers present then there will be no arrival 
with probability c(n) = (1 — b{n)) - or there is exactly one arrival which is of 
type m with probability 6(n) • a(rn) > 0, m G M, such that fi(™) = 1 

holds. 

We assume the successive arrival decisions to depend on the history of the sy- 
stem only through the total population size in system at the begin of the present 
time slot and the type decisions to be independent of the system’s history. We 
assume late arrivals and for multiple events we assume the D/A rule (departure 
before arrival), for details see the description before theorem 2.3. The state of 
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the system is recorded at times t G IN, just after possible departures and arrivals 
have happened. 

The amount of service a customer requests for depends deterministically on 
the customer’s type. A customer of type m G M will request for an amount of 
K{m) time units of service time, K{m) G INy. To exclude trivialities we assume 
that there exists at least one customer type who requests for more than one time 
unit of service time. 

The requirement of having deterministic service times is not a restriction but 
opens the possibility of versatile modeling probabilistic behaviour of customers. 
The key is the introduction of different customer types and type dependent 
behaviour: The random decision for the service requests are done by selecting 
the customer’s type suitably when entering the network. 

To be more specific: If we start with a set of (physical) customer types re- 
questing for service according to general type dependent distributions we may 
discriminate between sampled different requests for a given customer type by 
introducing ficticious customer types. Each ficticious customer type carries in- 
formation about the physical type of that customer, and his exact amount of 
requested service. This concept will allow stochastically dependent service re- 
quests at the successive doubly stochastic nodes on a customer’s itinerary in the 
networks defined in sectioon 5.3 and 5.6. 

Following from this description the construction of a suitable state space for 
a Markovian description of the node’s evolution necessarily must include at least 
the following state information - from the description of the service disciplines 
below it will follow that this information does already suffice: 

The state space S consists of elements x as follows: 

X := e for the empty node, and sequences 

X := [m{n), k{n); . . . ; m(l), fc(l)], n > 1 
where n is the number of customers present at the node {queue length of the 
node), m{i) is the type of the customer on position i, and k{i) his residual 
request for service time (his residual work). 

Roughly the service disciplines can be now be described by the following four- 
step procedure, where we assume throughout x := [m{n),k{n); . . .;m{l),k{l)] 
or a; = e to be a generic state as described above: 

Definition 5.1 (Doubly stochastic discipline. Part I) 

(1) A customer present at time t in a busy position i € {!,..., C{n)} obtains 
exactly one unit of service time until time t + 1. 

If k{i) > 1 then at time {t + 1)— this residual workload is diminished to k{i) — 1. 
Ifk{i) = 1 then this customer departs from the node at time (t-|-l) — . (But notice 
the restriction on the departure rules given below in (4)-) 

(2) Assume a customer of type m observes just before his entrance (which 
will happen between t— and t) the node in state x. 

If X = e, then the state changes to 



[m,K{m)]; 
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else if X := [m(ri), k{n ); . . . ; m(l), /c(l)] is the state of the system if at time t— 
all residual service times of customers on busy positions are decreased, and if no 
arrival appeared, 

then with probability 1/C{n+ 1) the state changes to 

X := [m{n), k(ji ); . . . ; fc(i+l); m, K{m); m(i— 1), fc(z— 1); . . . ; m(l), fc(l)], 

for some i G {1, . . . , C{n+ 1)}. A new arrival is inserted with probability 1 into a 
busy position and therefore has immediate access to service capacity. His position 
is randomly selected among the busy positions. 

(3) Due to the discrete time scale at any time point there may occur multiple 
events composed of several arrival and departure events. Our rule to handle 
these multiple events resembles what is known as rejection blocking or repetitive 
service in multiple access transmission systems with limited buffer capacity [105], 
p. 455 . The details: 

If a multiple event occurs where several customers simultaneously wish to 
enter and/or to leave nodes of the network, then not all of the requested transi- 
tions are allowed: 

Customers wishing jointly to depart due to their service completions have to 
stay at their present position for obtaining just another service (retrial of trans- 
mission). This request for service time is deterministically selected and identical 
to the previous service there. The only exception is: 

If several services expire jointly and at the same time instant an arrival occurs 
then from the departure candidates we select randomly one who departs and is 
substituted at his position by the new arrival. 

Therefore just one single external arrival and at most one service completion 
with a subsequent departure from the node can be observed. Especially no access 
conflicts with respect to the handling of multiple events can happen. 

(4) Assume that according to (1) or (2) exactly one arrival or one service 
completion or according to (3) a multiple event appeared and is handled. Then 
all the stay-on customers, i.e., those customers staying before on idle positions 
and customers on busy positions whose service did not expire, are permuted on 
their positions according to some probability law. This law may depend on what 
has happend in (1),(2),(3) and on the state of the node. (For more details see 
the description in part II, definition 5.2 and part III, definition 5.5.) 

The only restriction is: Given an event as described in (1),(2),(3), then the 
transition matrix which governs the feasible state transtions due to the permutati- 
ons is in a certain way doubly stochastic. (See below. Part III of the definition.) 
If this is the case the node is called doubly stochastic or a doubly stochastic 
server. Such nodes are said to work under a doubly stochastic discipline. 

We now give the details of the doubly stochastic disciplines according to [117]. 
We do not use that the transition laws exhibit the property of being doubly 
stochastic. Therefore we define a more general discipline but shall finally reduce 
our investigations to the case of doubly stochastic systems to obtain an explicit 
product form steady state. 
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In the following for a given state x € S we shall call customers to be stay- 
on customers if they either occupy an idle position or if they are on a busy 
position i < C{n) showing a residual work of k{i) > 1. A customer is a departure 
candidate if he is in a busy position i with residual work k(i) = 1. Customers 
on some position i are called a fresh customer if they show their total service 
request K{m) = k(i) as residual work. 

Definition 5.2 (Doubly stochastic discipline. Part II) 

(A) If the state of the node at time t is x := [m(n), fc(n); . . . ; m(l), A:(l)] yf e, 
and if there is no departure candidate and no arrival occurs at time t+ 1—, then 
the set A{x) of possible successor states at time t+1 of x is obtained as follows: 
Decrease the residual work of customers in busy positions by one and than 
permute the positions of the customers according to any permutation resulting 
in state y € A{x). This happens with probability 

c{n)d{x,y) >0, , ^ d{x,y) = l 

y&A{x) 



(B) If the state of the node at time t is x := [m{n), k(ri); . . . ; m(l), fc(l)] or 
X = e, and if there is no departure candidate and an arrival of type m € M 
occurs at time t+1—, then the set Am,i(x) of possible successor states of x with 
the new arrival inserted in position i, i € 1, • ■ • , C(n+1), at time t+1 is obtained 
as follows: 

Decrease the residual work of customers in busy positions by one, insert the 
new arrival in position i and than permute the stay-on customers on positions 
1, . . . ,i — l,i + 1, . . . ,n + 1 according to any permutation resulting in state y G 
Ara,i{x). This happens with probability 

b{n)a{m)C{n + l)~^d~^ (x,y) > 0, d~^{x,y) = l. 

yeAm,i{x) 



(Note that a new arrival is taken into service immediately, his position is chosen 
at random, and the rearrangenment of the stay-on customers may depend on the 
previous state of the node and on the type and position of the new arrival.) 

( C) If the state of the node at time t is x := [m(n), fc(n); . . . ; m(l), k{l)] yf e, 
and if there is exactly one depature candidate and no arrival occurs at time t+1—, 
then the set A{x) of possible successor states at time t+1 of x is obtained as 
follows: 

Decrease the residual work of customers in busy positions by one, delete the 
departure candidate and than permute on positions 1,. . .,n— 1 the stay-on cu- 
stomers according to any permutation resulting in state y G A{x) . This happens 
with probability 



d (x,y) = 1. 

y&A{x) 



c{n)d {x,y)>0, 
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(Note that the rearrangenment of the stay-on customers may depend on the pre- 
vious state of the node and on the type and position of the departing customer.) 

(D) If the state of the node at time t is x := [m{n), k(ji ); . . . ; m(l), fc(l)] ^ 
e, and if there are k > 1 departure candidates occupying positions ii,...,ik, 
and an arrival of type m € M occurs at time t + 1—, then the set Ajn,i{x) of 
possible successor states of x with the new arrival staying in i at time t 1, 
i € 1, • ■ • , C{n) + 1, zs obtained as follows: 

Decrease the residual work of customers in busy positions by one, select at 
random one of the departure candidates who is allowed to depart and the new 
arrival is inserted in his previous position. All other departure candidates stay 
on their possitions and become fresh jobs again requesting for a further service 
of K{m{ii)) time units, I = l,...,k. Then permute the stay-on customers on 
positions {1, . . . , n} — {zi, . . . , ik} according to any permutation resulting in state 
y G Am,i{x). This happens with probability 

b{n)a{m)k~^d'^{x,y) > 0, , ^ d~^{x,y) = l. 

yeAm.iD) 

(Note that the rearrangenment of the stay-on customers may depend on the 
previous state of the node and on the type and position of the new arrival.) 

(E) If the state of the node at time t is x := [m(ji), k{n ); . . . ; m(l), A:(l)] ^ e, 
and if there are k > 2 departure candidates occupying positions ii,. . . ,ik, and 
no arrival occurs at time t 1—, then the set A{x) of possible successor states 
at time t + 1 of x is obtained as follows: 

Decrease the residual work of stay-on customers in busy positions by one, 
converte the departure candidates into fresh jobs staying on their previous po- 
sitions and requesting for a further service of K{m{ii) time units, I = 1, . . . ,k. 
Then permute the stay-on customers on positions {1, rz} — {zi, , ik} 
according to any permutation resulting in state y € A(x). This happens with 
probability 

c{n)d{x,y) >0, ^ d{x,y) = l 

yeA(x) 

(Note that the rearrangenment of the stay-on customers may depend on the 
previous state of the node.) 

From the description of the queueing discipline and the stochastic assumpti- 
ons put on the systems it follows that the time evolution of the system can be 
described by a homogeneous Markov chain X = {X(f) : t G IN) with state space 
S described above. Assuming the node to be doubly stochastic we shall prove 
the existence of a stationary measure, which is said to be of internal product 
form, for this Markov chain. The formal definition of being doubly stochastic 
will be given in the proof of the theorem. 

Theorem 5.3 (Stationary measure) The Markov chain X = {Xt : t G IN) 
describing a doubly stochastic node’s evolution has a stationary measure it = 
(ir(x) : X G S) on S given by 
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7r([m(n), fc(n); . . . ; m(l), /c(l)]) = 



UVoHh) 



nL 

[m{n),k{n); . . .; m(l), fc(l)] G S. 



h=o c(^) 



n 



a{m{h)) 
C{h) ■' 



(5.1) 



Let p = a{m)K{rn) denote the mean service request of an average (ty- 

pical) customer. An immediate consequence of theorem 5.3 is an insensitivity 
result similar to those obtained for non-FCFS nodes in BCMP networks and for 
Kelly’s symmetric servers. 



Corollary 5.4 (Steady state) The stationary measure it can he normalized to 
a probability law tt = : x € S) if and only if A = ^(''^) < oo holds, 

where 7r(0) = c(0)“^ and for n > 0 



7r(n) 



( uVoKh) \ 

[Ul=oC{h)) 



■ {p - 



i=l 



If the node is doubly stochastic and A < oo holds then the steady state tt is 
given by 



7r([m(n), fc(n); . . . ; m(l), fc(l)]) 



riLd b{h) A a{m{h)) ^ 

C(h) 



(5.2) 



[m(n), k{n)] . . . ; m(l), fc(l)] G S. 



The equilibrium queue length distribution t: on M is 

^ ( nH^w ) ' ' A 

The equilibrium queue length distribution is insensitive under perturbations of 
the service time distributions as long as their mean is fixed. 

Proof of theorem 5.3: We follow the lines of the proof for the case of state 
independent arrival rate 6(n) = 6 in section 2 of [117] and use a partial balance 
technique which splits the global balance equations 

= '^TT{y)P{y,x), X € S, (5.4) 

y&S 



into partial equations, where {P{y, x) : y,x € S) is the transition probability of 
X. If these partial equations share a common solution tt they sum up to (5.4). 
The first equation of (5.4) for x = e reads 



1 

W) 



1 

W) 



c(0) + E ( 

m^M 



m 

c(0)c(l) 



a(m))c(l). 



(5.5) 



Now let X = [m{n) , k{n )] . . . ; m(l), /c(l)j and assume that x shows no fresh jobs, 
i.e., k{i) < K{m{i)) for all positions i = 1, . . . , n. The sum in the righthand side 
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of (5.4) is split into two sums. One type of predecessor states y G are 

those states which are obtained from x by arbitrarily rearranging the customers 
on positions 1, . . . , n and increasing the residual work by one for those customers 
staying now on the busy positions. Then the right hand side of (5.4) is 



E 



( Ul=o Kh) A a{m{h)) \ 

'vnLoc(MM J 



c{n)d{y,x), 



(5.6) 



where d{y,x) is defined in definition 5.2, (A). If 



E %>a;) = l, (5.7) 

yGA^{x) 



then (5.6) reduces to 



c{n)Tr{x). (5.8) 

The second type of predecessor states y G A°j(x), of x are those states which 
are obtained from x by inserting a fresh customer of type r G M in position 
i, i G C(n + 1)}, according to the shift protocol and then arbitrarily 

rearranging the customers on positions — + and increasing 

the residual work by one for those customers staying now on the busy positions. 
Then the right hand side of (5.4) is 



E 



Ul=oHh) 

jn+l 



a{m{h)) a{r) 



n 

\h=l 



C{h) C{n+l) 



c{n+l)d (y,x), 



where d (y,x) is defined in definition 5.2, (C). If 



then (5.9) reduces to 



E ^ 

yeAG{x) 



c(n)Tt(x) 



b(n)a(r) 

C(n+1)' 



(5.9) 



(5.10) 



(5.11) 



Summing (5.1) over all positions i = 1, . . . , C(n + 1), and all types r G M yields 
the left hand side of (5.4). 

Next we consider a generic state x = [m{n), k{n ); . . . ; m(l), fc(l)] with exactly 
one fresh job which is of type r in position i, i.e., m{i) = r and k{i) = K(m{i)), 
and for all other positions j yf z we have fc(j) < 

The sum in the righthand side of (5.4) is split into two sums. One type of 
predecessor states y G A’^(x), are those states which are obtained from x by 
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deleting the fresh customer and arbitrarily rearranging the other customers on 
positions 1, . . . , n — 1 and increasing the residual work by one for those customers 
staying now on the busy positions. Then the right hand side of (5.4) is 



E 



/n— 1 



nzlKh) 

nZo c{h) 



n o(w(/i)) 



h = l 
h^i 



b{n-l)a{r)^^dAy,x), 



(5.12) 



where d~^{y,x) is defined in definition 5.2, (B). If 



E d~'~{y,x) = l, (5.13) 

yGA^{x) 



then (5.12) reduces to 



c{n)Tr{x). 



(5.14) 



The second type of predecessor states y £ A^,.(x), of x are those states which 
are obtained from x by deleting the fresh customer of type r on position i and 
substituting him by a departure candidate of type r' £ M and then arbitrarily 
rearranging the other customers on positions l,...,t— l,z+l,...,n, increasing 
the residual work by one for those customers staying now on the busy positions. 
Then the right hand side of (5.4) is 



E 

y—[m'{n),k'{n);...;r',K{r');...;m'(l),k'(l)]£A^f^{x) 



nLoc('*) 



a{m' {h))a{r 



h^i 




b{n)a{r)d~'~{y,x), 



(5.15) 



where d'^{y,x) is defined in definition 5.2, (D). If 



E ^^(y>a;) = l, (5.16) 

yeA°,.(x) 



then (5.15) reduces to 



b{n)a{r')%{x). 



(5.17) 



Summing (5.17) over all types r £ M and adding (5.14) yields the left hand side 
of (5.4) for this case. 

The only remaining states are of the form x = [m(n), k{n ); . . . ; m(l), /c(l)] 
with exactly k >2 fresh customers in positions ii, . . . ,ik, being of type m{ii) in 
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position ii with k{ii) = K{m{ii)), and for all other positions j ^ i\, . . . ,ik we 
have k{j) < K{m{j)). 

The sum in the righthand side of (5.4) is split into two sums. One type of 
predecessor states y £ are those states which are obtained from x by 

fixing the fresh customers on their positions with maximum residual work and 
arbitrarily rearranging the other customers on positions {1, . . . , n} — {ii, . . . , ik}, 
increasing the residual work by one for those customers staying now on the busy 
positions. Then the right hand side of (5.4) is 



y—[m'(n),k'(n): 



E 



f OLd fV a(m(h)) \ 

[nLoc(h)l{ c(h) ) 



c{n)d{y,x), 



(5.18) 



where d{y,x) is defined in definition 5.2, (E). If 

E %> 2 ;) = 1 , 

y£A^{x) 

then (5.18) reduces to 



c{n)Tr{x). 



(5.19) 



(5.20) 



The second type of predecessor states y £ A^,^^{x), of x are those states which 
are obtained from x by deleting the fresh customer of type m(i/) on position 
ii and substituting him by a departure candidate of type r' £ M, fixing the 
residual fresh customers on their positions with max;imal residual work and then 
arbitrarily rearranging the other customers on positions {1, . . . ,n} — {ii, . . . ,ik}, 
increasing the residual work by one for customers staying now on the busy po- 
sitions. Then the right hand side of (5.4) is 



E 

y—[m'{n),k'{n);...;r',K{r')-,...;m'{l),k'{l)]^A^, . (x) 
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(5.21) 



n a{m'{h))a{r') 
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b{n)a{m{ii))-d'^{y,x), 

k 



where d~^{y,x) is defined in definition 5.2, (D). If 

E '^^(y>a:) = l, (5.22) 

(A 

then (5.21) reduces to 

b{n)a(r')—n{x). (5.23) 

k 

Summing (5.23) over all positions i = 1, . . . ,k and all types r' £ M and adding 
(5.20) yields the left hand side of (5.4) for this case. O 
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Definition 5.5 (Doubly stochastic discipline; Part III) A queueing disci- 
plin according to definitions 5.1 and 5.2 is doubly stochastic if it fullfills ad- 
ditionally (5.7), (5.10), (5.13), (5.16), (5.19), and (5.22). 

Example 5.6 (Doubly stochastic disciplines) The class of doubly stocha- 
stic comprises especially nodes with the following queueing disciplines: Last- 
Come-First-Served (preemptive resume) , infinite servers, random service allo- 
cation, round-robin with a preemptive modification for new arrivals queueing 
regimes. 

First-Come-First-Served is not included because immediate service must be gu- 
aranteed for a doubly stochastic node. For details see [117]. 

The doubly stochastic servers can be considered to apply a permutation di- 
scipline to the customers in the node. This permutation should in general not 
being considered as a rule for physically redistributing stay-on customers at 
every time epoch. The more common interpretation is that the service capacity 
of the node is redistributed to the customers present. E.g., applying a suitable 
permutation rule would guarantee fairness of service for all customers entering 
the node. This was discussed e.g. for the case of processor sharing by Kleinrock 
[82], pp. 166-172. Processor sharing in its classical definition for the continuous 
time framework is fair without applying a permutation rule because of the ho- 
mogeneous distribution of service capacity among the customers in system. 
Permutation rules for general symmetric servers in isolation were introduced by 
Yashkov [143] . Moreover, these permutation rules open the possibility to control 
the service process nearly continuously. 



5.2 Description of the Geometrical Server 

In this section the analogue of the exponential FCFS nodes in the BCMP net- 
works or, more general, of Kelly’s general exponential servers is investigated. 
These nodes are fed by a state dependent arrival stream of customers which are 
of different types m £ M, M being a countable set of types. 

The node consists of an unlimited sequence of service and waiting positions 
1,2,3, . . . which is controlled according to the shift-protocol. Whenever there are 
n customers present, n > 1, they will occupy positions l,...,n. If the custo- 
mer in position i € {1, . . . , n} departs from the node then the gap is closed by 
shifting the customers previously on positions i -\- 1, . . . ,n one step down into 
positions i, . . . ,n — 1, leaving their internal order invariant. Likewise if an addi- 
tional customer is inserted into position i £ {1, . . . ,n}, the customers previously 
on positions i, . . . ,n are shifted one step up into positions f-l- 1, . . . , n-l- 1, leaving 
their internal order invariant. 

Having n > 0 customers present at the node service is provided to those 
customers staying on positions 1, . . . ,C(n), where C(n) > 0 is a node specific 
service parameter. We call positions l,...,C(n) busy, while positions C{n) -\- 
1, . . . , n are said to be idle. (C(0) := 0.) 
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Customers entering the node request for an amount of service time which will 
be provided to them according to the service disciplin (to be described below) 
of the node. 

If at time t G IN there are n customers present then there will be no arrival 
with probability c(n) = (1 — b(n)) - or there is exactly one arrival of type m 
with probability b{n) ■ a{m) > 0, m G M, such that = 1 holds. 

We assume the arrival decisions for a time slot to depend on the history of the 
system only through the total number of customers in system at the beginning 
of that time slot, and the type decisions to be independent of the history of the 
system. We assume late arrivals and for multiple events we assume the D/ A rule 
(departure before arrival). The state of the system is recorded at times t G IN, 
just after posible departures and arrivals have happened. 

The amount of service a customer requests for is geometrically distributed 
with a node characteristic parameter p G (0, 1) for all types of customers. The 
sampling of service times is independent and independent from the arrival pro- 
cess. 

Following from this description a suitable state space S for a Markovian 
description of the node’s evolution over time IN consists of elements x as follows: 

X := e for the empty node, and sequences 

X := [m{n); . . . ; m(l)], n > 1 

where n is the number of customers present at the node {queue length of the 
node), m{i) is the type of the customer on position i. (Due to the memoryless 
property of the geometrical distribution we need no information about residual 
work or age of service time.) 

Definition 5.7 (Geometrical discipline) 

(1) A customer present at time t in a busy position i G {!,..., C{n)} obtains 
exactly one unit of service time until time t+1. With probability p his service ends 
at the end of [t,t+ 1), and he departs from the node. (But notice the restriction 
on the departure rules given below in (4).) With probability q = 1—p he requests 
for at least one more service quantum. 

(2) An arriving customer observing n other customers already present enters 
position n+l,n> 0. (But notice the restriction on the arrival rules given below 
in (4)) Applying the shift-protocol then leads to a FCFS-based service. 

(3) If more than one customer complete their service at the same time instant 
they are not allowed to depart jointly. They have to stay at their present position 
for obtaining just another service (retrial of transmission) . 

(4) If an arrival occurs and at least one services expires jointly at the same 
time instant then the departure candidates stay for another service on their po- 
sitions and the arrival candidate is rejected and lost. 

Therefore either one single external arrival or at most one service completion 
with a subsequent departure from the node can he observed. 

From the description of the queueing discipline and the stochastic assump- 
tions put on the systems it follows that the time evolution of the system can 
be described by a homogeneous Markov chain X = {X(t) : t G IN) with state 




5.2. Description of the Geometrical Server 



85 



space S described above. To prove the existence of a stationary measure is done 
by direct verification of (5.24) as a solution of the steady state equation. This 
solution is said to be of internal product form again. 

Theorem 5.8 (Stationary measure) The Markov chain X = {Xt : t G M) 
describing the evolution of a geometrical node has a stationary measure it = 
(tt(x) : X G S) on S given by 

7r([m(n); . . . ; m(l)]) [m{n); . . . G S, (5.24) 

TT a{rn{h)) /gV 

C{h) \p) \q) ■ 

An immediate consequence of theorem 5.8 is an ergodicity criterion for geome- 
trical nodes. 



Corollary 5.9 (Steady state) The stationary measure it can be normalized to 
a probability law tt = (7t(x) : x G S) if and only if A = ^(''^) < oo holds, 

where 7tj(0) = c(0)“^ and for n > 0 
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(5.25) 



nGW. (5.26) 



Remark 5.10 (Slotted Aloha— type protocol) The restriction concerning 
the departure and arrival rule for the geometrical node can be interpreted as 
describing transmission stations in a slotted Aloha-type communication system, 
[82], section 5.11, [142], section 6.2. If there are C{n) sources of traffic (sta- 
tions), and the end of a service in position i G C(n)} indicates that a 

message has to be transmitted over the shared medium, then this is possible if and 
only if exactly one service ends. If more than one service ends, and more than 
one message is tried to be send at the same time instant, all those transmission 
trials are not successful and have to be repeated. A common regime to resolve the 
conflicts is that the sources retry at random to repeat sending. This is just what 
is going on in a geometrical server according to (3) in definition 5.7. 

Due to the memoryless property of the geometrical service time distribution the 
blocking mechanism according to repititive service is equivalent to what is known 
as communication blocking, [105[, p.)55. 
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5.3 Open Networks of Doubly Stochastic and 
Geometrical Nodes 

Performance prediction for complex networks in computer and communication 
systems is usually done either by simulation or by using exact or approximative 
analytical methods. The usefulness of analytical methods strongly relies on ha- 
ving simply structered models at hand. Or, saying it the other way round: In 
the modeling process we have to impose structural assumptions on the systems 
which in fact are approximations of the more complicated direct description. The 
networks under consideration in this section show several such approximations: 

First: They are constructed along the lines of the the celebrated BCMP net- 
works [4] and Kelly’s networks [75]. These networks are now widely accepted 
as a versatile class of queueing networks, which simulate sufficiently detailed 
the behaviour of many complex systems. The latter class is a generalisation 
of the former one, because it removes the restriction on allowing only proces- 
sor sharing, Last-Come-First-Served(preemptiveresume), infinite server , and 
exponential First-Come-First-Served regimes for the nodes by introducing the 
so-called general exponential and symmetric servers. 

Second: We substitute the symmetric and exponential servers by doubly sto- 
chastic and geometrical servers, where multiple events are controlled by the rules 
described insections 5.1, 5.2. 

Third: We shall impose a similar global regulation regime for multiple events 
originating from the synchronized behaviour of the different nodes. 

Due to these modeling assumptions not only the steady state probabilities 
of the networks can be computed explicitly, but main performance quantities 
are directly accessible as well. An appealing property is that the first order 
mean values of the relevant performance measures are insensitive: They remain 
invariant under variation of shape of the customers’ service time distribution at 
doubly stochastic servers as long as the mean service time remains invariant. 

The network of queues in this section consists of J nodes and is fed by a 
Bernoulli arrival stream of customers which are of different types m G M, M 
being a countable set of types (not containing natural numbers for making the 
later state description unambiguous). 

At any time t G IN there is either no arrival, with probability c = 1 — 6, 
or there is exactly one arrival, being of type m with probability b ■ a(m) > 0, 
m G M, such that a(m) = 1 holds. We assume the successive arrival and 

type decisions to be an independent sequence being independent of the previous 
history of the network. 

The type m of an arriving customers uniquely specifies the route of this 
customer through the network: W{m) = {W{m,l),W{m,2), . . . ,W{m, S{m))), 
where node W {m, i) is the tth stage of m on his itinerary, and 1 < S{m) < oo is 
the length of his route. We assume for simplicity of presentation that W (m, i) yf 
W{m,i -I- 1),1 < i < S{m). (For a short description of how to remove this 
restriction see [33].) 
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The nodes of the network are of two different types: 

Nodes < J' < J, are doubly stochastic (see section 5.1), and 

resemble Kelly’s symmetric nodes in continuous time queueing systems (see [75] , 
Chapter 3.1 and 3.3). Nodes J' + l, . . . , J are geometrical nodes (see section 5.2), 
which are the counterparts of exponential multiserver and general exponential 
servers, respectively. 

If Uj > 0 customers are present at node j service is provided to those custo- 
mers staying on positions 1, . . . ,C{j,nj), where C{j,nj) > 0 is a node specific 
service parameter. We then call positions 1, . . . , C(j, n^) busy, while positions 
C{j, Uj) + 1,. . . ,n are said to be idle. (We set C(j, 0) := 0, 1 < j < J.) 

Customers entering node j G {1, . . . , J} request at this node for an amount 
of service time which will be provided to them according to the service discipline 
of that node. 

The amount of service time a customer requests for at a geometrical node j is 
node specific geometically distributed onIV+ = {1,2,...}. A customer requests 
with probability Pj{l — , pj G (0, 1], for exactly k time units of service 

at node j, k G IV 4.. These geometrical service times are drawn independently 
and independent of anything else in the history of the network. 

The amount of service a customer requests for at a doubly stochastic node j 
depends deterministically on the customer’s type and the stage number he has 
reached on his passage through the network. If a customer of type m, m G M, 
enters stage s, 1 < s < S{m), of his route, which is according to the definition 
W(m,s) = j, he will request for an amount of K{m,s) units of service time, 
K{m, s) G INy. 

We assume that for every doubly stochastic node there exists at least one 
customer who requests at this node for more than one unit of service time. 

The requirement of having deterministic service times at doubly stochastic 
nodes is not a restriction but widens considerably the possibility of modeling the 
probabilistic behaviour of customers at doubly stochastic nodes. The key is the 
introduction of different customer types and of the type and stage dependent 
behaviour: The random decision for the successive service requests at doubly 
stochastic nodes on a customer’s route is done by selecting the customer’s type 
when entering the network. 

To be more specific: Let us assume that we have a set of customers with 
different (physical) customer types requesting for service according to general 
(type- and stage-dependent) distributions at the doubly stochastic nodes of their 
route. We can discriminate between different sampled sequences of requests for 
a specific customer type by introducing ficticious customer types. Each ficticious 
customer type carries information about the physical type of that customer, his 
routing, and his exact successive amounts of requested service at his successive 
stages on his itinerary. This concept even allows for using stochastically depen- 
dent service requests at the successive doubly stochastic nodes on a customer’s 
itinerary. 
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It should be noted that a similar procedure for determining the service re- 
quests is possible in a network with random routing. Then different routes are 
distinguished by using types which include fixed route descriptions: 

These types are determined for any customer in advance when entering the 
network. Their routes (and their types) are sampled according to the Markov 
chain determined by the routing matrix. 

Following from the above description the construction of a suitable state 
space for a Markovian description of the network’s evolution over time should 
include at least the following information - from the description of the service 
disciplines below it will follow that this information does already suffice: 

The local state space Sj for a doubly stochastic node j,j € {1, . . . , J'} con- 
sists of elements Xj as follows: 

Xj := Cj for the empty node, and sequences 

Xj := [m{j,nj),s{j,nj),k{j,rij);...;m{j,l),s{j,l),k{j,l)], Uj > 1 
where rij is the number of customers present at node j {queue length at node j), 
m{j, i) is the type of the customer on position i, s{j, i) is the stage number of 
this customer on his actual route, and k{j, i) is his residual request for service 
time (his residual work), I < i < nj. 

The local state space Sj for a geometrical node j,j G { J' -I- 1, . . . , J} consists 
of elements Xj as follows: 

Xj := 6j for the empty node, and sequences 
Xj := [m{j, nj),s{j, Uj); m{j, 1), s(j, 1), ], > 1 

where Uj is the number of customers present at node j {queue length at node j), 
m{j, i) is the type of the customer on position i, and s{j, i) is the stage number 
of this customer on his actual route, 1 < i < Uj. (Here the residual workloads 
need not be included in the state description due to the memoryless property of 
the geometrical service time distributions at the nodes.) 

Global states of the network are composed of these local states. The state 
space of the network is therefore S' := x 5'2 x • • • x 5'j or a subset thereof. 

The service disciplines at the nodes are either doubly stochastic as described 
in section 5.1 or geometrical as described in section 5.2. It turns out that in case 
of a network with general toplogy we have to define some further rules which 
regulate the network’s behaviour at instances of simultaneous events. This is 
described in the following four-step procedure. 

Definition 5.11 (Queueing disciplines in the network) Throughout we as- 
sume X = {xi, . . . ,xj) € S to be a generic state of the network as described 
above and consider the possible state changes out of x: 

(1) A customer present at time t in a busy position i € {1, . . . ,C{j,nj)} of 
node j obtains until time t 1 exactly one unit of service time. 

If node j is geometric, this customers will leave node j thereafter (at time 
{t 1)— j with probability pj and will stay there for at least one further time 
unit with probability 1—pj. 

If node j is doubly stochastic , assume that the customers show at time t a re- 
sidual work of k{j, i) . 
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U k{j,i) > 1 then at time (t + 1)— this residual workload is diminished to 
k{j,i) - 1. 

If k{j,i) = 1 then this customer departs from node j at time (t + 1) — . (Note 
the restrictions as consequences of simultaneous events prescribed further for the 
departure candidates in (3) below.) 

(2) A customer of type m on stage s of his route enters node j := W{m, s), 
seeing just before his entrance (which will happen between some times t— and t) 
that node to be in local state Xj. 

For j being a geometrical node: if xj = ej, then the lokal state of node 

j changes to [m,s]; else if Xj := [m(j, rij), s(j, rij); . . . ; m(j, 1), s(j, 1)], then the 
local state changes to 

Xj := [m, s; m{j, nj),s{j, nj); ...; m{j, 1), s(j, 1)]. 

I.e., for geometrical nodes we have a FCFS-regime. 

For j being a doubly stochastic node: if Xj = Cj, then the lokal state of 

node j changes to [m, s, K{m, s)]; 

else ifxj := [m{j, nj),s{j, nj),k{j, Uj); ...; m{j, 1), s(j, 1), fc(j, 1)], then with pro- 
bability 1/C {j, Uj + 1) the local state changes to 

Xj := [m{j, nj),s{j, Uj), k{j, nj); ...; m{j, i + 1), s(j, i + l),k{j, i + 1); 

m,s,K{m,s);m{j,i- l),s{j,i~ l),k{j,i~ 1); 

1)], 

for some t G {1, . . . , C{j,nj + 1)}. I.e., for doubly stochastic nodes a new arrival 
is inserted with probability 1 into a busy position and therefore has immediate 
access to service capacity. His position is randomly selected among the busy po- 
sitions. 

(3) Due to the discrete time scale at any time point there may occur simul- 
taneous or multiple events composed of several arrival and departure events. 
Our rule to handle these multiple events resembles what is as repititive ser- 
vice/rejection blocking in multiple access transmission systems with limited buf- 
fer capacity. The details: 

If a multiple event occurs where several customers simultaneously wish to 
enter and/or leave nodes of the network, then none of the requested transitions 
is allowed: 

Customers on arrival from the outside source are lost (restarted); custo- 
mers wishing to depart from the network due to a service completion at node 
bF(-,S'(-)), or wishing to enter the next stage of their route due to service com- 
pletion on the present stage have to stay at their present node on their present 
position for obtaining just another service (retrial of transmission) . 

This request for retrial service time is distributed acccording to the node spe- 
cific geometrical distribution, if the node is geometrical. Otherwise, if the node is 
doubly stochastic, then the additional service request is deterministically selected 
and identical to the previous service there. (The additional service at the node 
is therefore not counted as an additional stage for the customer’s passage.) 
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Therefore at most one single external arrival or one service completion with 
a subsequent departure from some node can he observed. It follows that no access 
conflicts with respect to the handling of multiple events will occur. 

(4) Assume that according to (1) or (2) exactly one arrival or one service 
completion or according to (3) a multiple event appeared and is handled. Then all 
the stay-on customers at doubly stochastic nodes, i.e., those customers staying 
before on idle positions and customers on busy positions whose service did not 
expire, are permuted on their positions (nodewise) according to some probability 
law. This law may depend on what has happend in (1),(2),(3) and on the global 
state of the network. 

The only restriction is: Given an event as described in (1),(2),(3), then the 
transition matrix which governs the allowed state changes due to the permuta- 
tions is doubly stochastic in a similar way as defined in definition 5.5 and the 
proof of theorem 5.3. (For details see [33].) 

The continuous time counterparts of the networks with doubly stochastic and 
geometrical nodes were defined in [75] and [4] without the permutation rules for 
redistributing customers. This additional feature was invented by Yaskov [143] 
for single node systems, and for general networks in [25], for a description in a 
more general network environment see [30] . 

As can be seen from the definition, the permutation rules introduce rather gene- 
ral control schemes for discrete time networks: Redistributing customers among 
the busy positions or laying customers dormant on idle positions for some time, 
generates state dependent schemes for providing service to the customers. Ac- 
cording to the general decision rules for applying the permutations these rules 
may take into consideration the states of e.g. neighboured nodes for deciding 
which customers to serve. 

The restriction for movements in the network consisting of either a single arrival 
or a single departure from exactly one node according to the blocking protocol 
(repititive service/rejection blocking) resembles the departure protocol applied 
in [100] for batch service disciplines in discrete time networks. At every time 
epoch at most one node is selected to release a batch of customers being served 
to be distributed over the network or partially to leave the network. As Miya- 
zawa puts it, this model is motivated not only by the fact that it is important for 
discrete time queueing networks, but also by its tractability for analysis. This 
statement applies here and to the following sections of the chapter as well. 



5.4 Stationary State for the Open Network with 
Doubly Stochastic and Geometrical Nodes 

A detailed description of the transition laws which are sketched in section 5.3 is 
given in [33] in connection with solving the equilibrium equation of the Markov 
chain X = {Xt : t G IN) which describes the time evolution of the network. 

The state space S' = S'! x • • • x is not minimal. E.g., a customer of type 
m G M present at a doubly stochastic node W{m,s) = i < J', can show a 
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(maximal) residual work of K{m,s) time units if and only if he is on a busy 
position of j. 

We assume henceforth that S and S'j , 1 < j < J are restricted to those 
states showing feasible workloads for the customers present there. We define 
local measures for the nodes as follows: 

If j is a doubly stochastic node then = (Tfj(xj) : Xj G Sj) is given by 

TTj{ej) = 1, and 

nj),s{j, Uj), k{j, nj )] . . . ; m{j, 1), s{j, l),k{j, 1)]) (5.27) 

Ay-fi g(m(j,z)) 

{cj C{j,z) 

If j is a geometrical node then nj = (Ttj(xj) : Xj € Sj) is given by 

TTj{ej) = 1, and 



nj),s{j, nj)]...-, m{j, l),s{j, 1)]) 




\P]J \d]) C{j,i) 



(5.28) 



Theorem 5.12 (Stationary measure) The Markov chain X = (Xt : t G M) 
describing the network’s evolution has a stationary measure tt = (-?t(a;) : x € S) 
on S given by 



,7 

= ) */ X = {xi, . . . ,xj) & S. (5.29) 

i=i 

The proof of the theorem is along the lines of the proof of theorem 5.3: Identifying 
suitable partial balance equations which are solved by (5.29) individually and 
which sum up to a solution of the global balance equations. 

Now let 

bj = b ■ a{m), 1 < J < J, 

{m,s):W {m,s)=j 

denote the total arrival rate at node j, and pj the mean service request of a 
typical customer at node j: For a geometrical node j pj = pj^ and for a doubly 
stochastic node j pj = Y.(m,s)-.w(m,s)^j ba{m)bJ^K{m,s). 



Corollary 5.13 (Steady state) The stationary measure if can be normalized 
to a probability law tt = {tt{x) : x € S) if and only ^ °° holds for 

all j, where 7fj(0) = 1 and for n > 0 



7Tj{n) 




1 ) 



n 




Cij,n) 



2 = 1 
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5.5 Performance Measures for Open Networks 

We assume henceforth that normalization of tt is possible. This is the case if and 
only if the local measures itj : j = 1, J are normalizable as well, obtaining 
local probability laws iTj : j = 1, . . . , J. Starting X with distribution tt then 
yields X to be stationary with Pr{Xt = a;} = 7r(a;), x G S. We refer to this 
situation in the following as X to be in steady-state and derive the main steady- 
state performance measures of the network described by X. The proofs can be 
found in [33]. 

Corollary 5.14 (Steady state) For X being in steady-state let 
^3 = = 1, • ■ • , and A = Y{j=i Then 

TTj{xj) = TTj{xj) ■ A~^ is the steady-state probability of finding node j in local 
state Xj € Sj and 

TTj{n) = Ttj{n) ■ Aj^,n G JN is the steady-state queue length probability at 
node j, J = 1, . . . , J. We further have 

Pr{Xt = x} = 7 t(x) = 7t(x) ■ A~^, X G S. 

Remark 5.15 (Insensitive queue length distributions) The probability to 
see in steady state a queue length vector (ni, . . . ,nj) is 

J 

Y[TTj{nj) 

i=i 

obtained from Corollary 5.14- From the explicit form in Corollary 5.13 it follows 
that this probability is insensitiv.- It depends on the requested service times only 
through their means. So the stationary queue length distribution remains invari- 
ant if the service time distribution of a physical customer for doubly stochastic 
nodes is changed as long as the mean remains invariant. 

This remark applies for random service times as well. (See the remarks in sec- 
tion 5.3, page 81.) 

Related insensitivity results for single node systems in discrete time are proved 
in [43]. 

Corollary 5.16 (Loss probability) The steady-state loss probability for arri- 
vals from the outside of the network is 

,7 

Tn = l-\{Af -Bj, (5.30) 

i=i 



where 



oo / n 






n—O \i=l 



bjiTj - 1 ) ^ 



l< 3 <J- 



(5.31) 
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Corollary 5.17 (Mean queue length and node delay) Denote by 

( K{m,s) if W{m,s)<J' {doubly stochastic node), 
p{m,s) — <^ s) W{m,s)>J' {geometrical node), 

the mean requested service time of a customer of type m on stage s of his route. 
The steady-state mean number of customers of type m in stage s of their route 
is 



L{m, s) 

= b- a{m) ■ {A{W{m,s))p{m,s) — B{W{m,s))), m G M, 



(5.32) 
1 < s < S{m), 



where 



oo n / h \ ^ 

A{j) = 

n—1 i—1 ^ ^ 

- C{j,n)) 

and 

OO n / h \ ^ 

BU) = Gm 

n^l i=^l ^ ^ 

- l)"-i-^(^»(n - C{j,n)). 

The mean sojourn time T{m,s) (waiting time + service timej of a customer of 
type m on stage s of his route at node W {m, s) is 

T{m,s) (5.34) 

= A{W{m,s))p{m,s) — D{W{m,s)), m € M, 1 < s < S{m). 

Corollary 5.18 (Mean response time) The steady-state mean response time 
(passage time) T{m) of a type m customer is 

S{m) 

T{m) = ^2{A{W{m,s))p{m,s) — B{W{m,s))), (5.35) 

S = 1 

where the response time is counted as zero if the job is lost. Conditioned on a 
customer being accepted by the network his response time is ((5.35) x (1 — tt/)”^). 

Remark 5.19 (Conditional response time) A customer’s mean sojourn time 
T{m,s) ( 5 . 34 ) is an affin-linear function of his requested mean service time at 
the node W{m, s). A customer’s mean response time T{m) is an affin-multilinear 
function of his successive mean service requests at the nodes of his path W{m). 

Recall that the requested service times at doubly stochastic nodes are determi- 
nistic K{m,s). As we pointed out in Section 5.3 this can be used as a modeling 
device for handling the distribution of complex, even correlated, service times by 
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chasing suitable fictitious customer types. Then Hwim.s) = K{m, s) in (5.33) and 
(5.3)) for doubly stochastic nodes W(jn,s) is a conditioning event. It follows: 
Conditional mean response times of a physical customer are afiin-multilinear in 
his actual service time requests at the doubly stochastic nodes. 

Parallel results for continuous time networks with symmetric nodes ( including 
the special cases of Baskett, Chandy, Muntz, and Palacios [)], can be found 
in [22] and [3[. The proofs are much more elaborated then their discrete time 
counterparts presented here. A detailed discussion of this property for single node 
systems with respect to performance analysis and fair service regimes can be 
found in [82], pp. 166-172. 

Remark 5.20 The brute force resolution of multiple event access conflicts de- 
scribed under (3) in Section 5. 3 results in explicit performance measures for our 
discrete time networks. The impact of this conflict resolution scheme is neglec- 
tible e.g. with respect to individual loss probabilities if the mean service times of 
a typical customer at the nodes is sufficiently large. We then have in Corollary 
5.16 that Bj in (5.31) is appoximately Aj and in (5.30) tt ; ~ 0 . 

Similarly to the simplifications discussed in Remark 5.20 the main perfor- 
mance measures of the network simplify considerably under the 



Assumption 5.21 (Small time slots) The mean requested service time of a 
typical customer at the nodes is sufficiently large, which means pj fv pj — 1, 



Corollary 5.22 Assume that the assumption 5.21 holds. 
Then for j = 1, . . . , J 



Aj) = 



E(n 



Pj 









{npj - C{j,n)), 



and 



m 



jfj_ 

^3 bj 



E(n 



_jfj__\ 

c{jfly 







Insert this into (5.32), (5.3)), and (5.35) to obtain the simplified performance 
approximations. 



Remark 5.23 The rules to handle multiple events can be interpreted as follows: 
We introduce a dependence between the nodes to guarantee that the arrival and 
departure structures and in general, the customer flows in the network, will be 
simple. The question arises whether this rule, described in (3) of definition 5.11, 
Section 5.3, is the only possible one, which provides us with explicit product form 
equilibria. 

The answer is ”No”. This can be seen from the detailed investigation of the 
isolated doubly stochastic node in [117], see section 5.1 above. There it is allowed 
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that at most one departure may concurrently occur with a single arrival. The 
steady state then is of product form. Even more can he concluded from Theorem 
3 in [117]: If we consider an open linear tandem of doubly stochastic nodes with 
capacity 1, then in steady state the queue lengths behave as if they are independent 
(see section 5.7). 

Incorporating simultaneous jumps of many customers between different nodes 
into the more general networks with correlated service requests, global reshuffling 
regimes for stay-on customers, and general topologies considered here, leads to 
an enormous combinatorial complexity and is an open problem for further rese- 
arch. For a discussion of this problem see [61], Section 8. There a connection to 
continuous time networks is pointed out, which indicates how to obtain further 
discrete time systems with product form equilibrium. 



5.6 Closed Networks of Doubly Stochastic and 
Geometrical Nodes 

In this section we consider a closed network of geometrical and doubly stochastic 
nodes as described in section 5.1 and 5.2. These are networks with a structure 
as described in section 5.3 without external arrivals, but with a fixed set of K 
customers cycling in it. We assume the nodes of the networks to be numbered 
as in section 5.3, nodes 1 through J' are doubly stochastic, nodes J' + 1 through 
J are geometrical. The characteristics of the nodes are those of section 5.3. The 
finite routes of the customers are completely determined by their types: 

W{m) = {W{m,l),W{m,2), . . . ,W{m, S{m))), where W{m,i) is the ith 
stage of m on his itinerary, and 1 < S(m) < oo is the length of this route. 
We assume again for simplicity of presentation that W{m,i) yf W{m,i-\- 1), 1 < 
i < S{m). 

After departing from a route the customer changes his type according to 
some Markovian rule: 

A customer being of type m on leaving node W{m, S{m)) becomes a customer 
of type m' with probability r{m,m') > 0, m,m' € M, where R = (r(rn,m') : 
m, m' G M) is a stochastic matrix. We assume R to be irreducible on M and 
positive recurrent. This is the single chain case as discussed in section 3.1. The 
multichain framework (see section 3.2) yields results similar to those to be pre- 
sented below. 

We assume that for every doubly stochastic node there exists at least one 
customer who requests at this node for more than one unit of service time. 
A special case of this class of networks was investigated by [118], the general 
formulas of this subsection were obtained by Kruger [89] . 

We denote the state space of the network by S{K, J) which is a subset of 
S = Si X ■■■ X Sj, resembling the population size K and the network size 
J in the denotation. We use the same notations as in section 5.3 and assume 
minimality and irreducibility of the state space, i.e., any state in S{K, J) appears 
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with positive probability. The states and their interpretation are the same as in 
Section 5.3. 

Theorem 5.24 (Stationary measure) Let A = (A(m) : m G M) he the pro- 
bability solution of the system of traffic equations 

X = X-R. 

Let the local measures for the nodes he defined as follows: 

If j is a doubly stochastic node then ifj = (irj(xj) : xj G Sj) is given by 

Ttj{ej) = 1, and 

7tj([m(j, nj),s{j, nj),k{j,nj ); . . . ; m{j, l),s{j, 1)]) (5.36) 

TT Hm{j,i)) 

■ 

If j is a geometrical node then itj = (wjfxj) : Xj G Sj) is given by 

Ttj{ej) = 1, and 

nj),s{j, nj)] m{j, 1), s(j, 1)]) (5.37) 

f V' f ^ TT 

\Pj) \<lj) ,4.1 

(Note that the local measures do not reflect the restriction put on the sytem by 
the finite population size.) 

Then the Markov chain X = (Xt : t G IN) describing the network’s evolution 
has a stationary measure tt = (7r(a;) : x G S{K, J)) on S{K, J) given by 

J 

%(a;j) , if x = {xi, . . . ,xj) G S{K, J). (5.38) 

i=i 

The total arrival rate at node j, 

bj = A(m), l<j<J , 

{m,s):W {m,s)—j 

and the mean service request pj of a typical customer at node j is: For a geo- 
metrical node j 

Ml = Pj" 

and for a doubly stochastic node j 

Pj = Y X{m)bJ^K{m,s). 

{m,s):W {m,s)=j 

Because the set of customer types may be infinite the state space of X is in 
general not finite. So we need a criterion for the positive recurrence of the states 
of X in S{K, J). 
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Corollary 5.25 (Steady state) The stationary measure tt can he normalized 
to a probability law tt = (7t(x) : x € S{K, J)) if and only if for all j, j = 1, . . . , J 

bj < oo and pj < oo 

. A sufficient condition for positive recurrence is therefore the existence of con- 
stants such that 

S{m) < S < oo, m € M and 
K{m,s)<K<oo, {m,s) with W{m,s)<J'. 

The norming constant then is 

G{K,J)= Y. 

xeS{K,j) 

Computing the norming constant can be performed by an algorithm similar to 
Buzen’s algorithm. The algorithm is considerably simplified by the observation 
that different customer types do not occur in the relevant summation for the 
norming constant. 



Corollary 5.26 (Norming constant) Let S{K,J) = {(rii,...,nj) € IN'' : 
Yh'j=i = K}. Then 



G{K, J) 



J f rij 

E n n 

(ni,...,nj)GS(K,J) j = l K.i—1 



( {bjiTj - 1 )) \ 

I C{jd) j 







This immediately yields 



Theorem 5.27 (Buzen’s Algorithm) (Kriiger(83),[89]) Let g{k,j),k > 0,j > 1 
be defined as follows: 



g{k,i) 



n 



biiTi - 1 ) 
G{l,t) 



Ti 

Pi - I 



C(l,n) 

,fc = 0, 1, . . . 






and for j >2 and k > 0 



g{k,j) 



k 



E 




b]{Tj - 1 ) 

cUa) 




C(j,n) ' 



■ g{k-n,j - 1). 



Then G{K, J) = g{K, J). 



Having the steady-state probabilities for the network at hand and an algo- 
rithm for computing the norming constant, this enables us to obtain recursively 
marginal probabilities and mean values of the main performance measures (see 
[89]). A Mean Value Algorithm can be developed similarly to the standard case. 
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5.7 Open Tandems of Doubly Stochastic Nodes 
with State Independent Arrival Streams, 
and Reversibility 

In this section we reconsider the modeling principles for networks of doubly sto- 
chastic and geometrical nodes as described in definition 5.11, (3) and discussed 
in the beginning of section 5.3 and in remark 5.23. We determine an important 
subclass of networks of doubly stochastic nodes where the restrictions put on 
multiple events of definitions 5.11, (3), are not needed to obtain explicit product 
form steady states. The starting point is an output theorem of Schassberger for 
the doubly stochastic nodes described in section 5.1 with the additional require- 
ment of state independent Bernoulli arrival process, similar to that of Burke [16] 
(continuous time exponential nodes) and Hsu and Burke [65] (discrete time state 
dependent Bernoulli server), further references on classical output results can be 
found in [75]. From the output theorem we conclude stochastic independence of 
the queue lengths in equilibrium for open tandems of single server doubly sto- 
chastic nodes- without any constraints on simultaneous events at different nodes 
(which occur as single departures). The concurrent departures occurring at the 
same time epoch at different nodes are admitted and therefore no restarting of 
services due to multiple events is necessary. This yields for networks of nodes 
with service parameter Cj(rij) = 1 for all nodes a product form result without 
any restart of service or loss of customers at the entrance point of the network. 

A similar observation holds for networks of geometrical nodes: For an open 
tandem of single server Bernoulli nodes with a state independent Bernoulli arrival 
stream the steady state distribution is of product form, i.e., the joint queue 
length vector has independent coordinates (see [65] and theorem 4.1) above, 
which specializes to this case. In equilibrium the departure streams are Bernoulli 
processes. 

Schassberger’s result holds even for multiserver doubly stochastic nodes, i.e., 
for node j we have Cj (n) > 1 for some n and we regulate concurrent departures 
by repititive service/rejection blocking and restart of service ((3) in definition 
5.1). 

A review on the structure of output processes in continious time and di- 
screte time single node systems can be found in [45]. Using a matrix-analytic 
approach in this paper for the case of Markov modulated discrete time batch ar- 
rival processes and general (discrete) service time distribution in a single server 
the output process is characterized, allowing further that the server takes occa- 
sioally a vacation. Clearly, this prevents us from obtaining independence results 
similar to those presented here. 



Theorem 5.28 (Output theorem) [117] Consider a doubly stochastic node 
according to definitions 5.1, 5.2, and 5.5 with state independent Bernoulli- (b) 
arrival stream of different customer types and state process X = {Xt : t > 0) in 
equilibrium tt, see (5.2) of Corollary 5.), which is in this case 
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Tr{[m{n),k{n);...;m{l),k{l)]) = c ^ ^ 

[m(n), fc(n); . . . ; m(l), /c(l)] G S. 

Note that we have assumed the D/A-rule and that the state at time t is recorded 
just after possible departures and arrivals have happened at time t—. Let D = 
(Df : t = 1,2, . . .) denote the departure process from the node, i.e., Dt = m if at 
time t— there is a departure of type m G M , and Dt = 0 otherwise. 

Then for any to > 1 the state Xtg and the departure process {Dt : t = 1,2, . . . ,to) 
up to time to are stochastically independent. 

D is an i.i.d. sequence of random variables with 

P{Dt = m) = ba{m), m € M, P(0) = c. 

Proof : We use induction. By direct computation it is shown that P{Xi = 
X, Di = mi) = P{Xi = x)P{Di = mi) holds. Let to > 1. 

For X € S,mt € M U {0}, t = 1,. . . ,to we have 

P{Xtg =x,Dt = mt,t=l,..., to) 

= X! ^to -1 = y,Dt = mt,t=l,...,to) 

v&s 

= X! ^^^*0 = 2^. Ao = mto \Xto-i = y, Dt = mt,t = 1, . . . ,to - 1) 
v&s 

P{Xtg-i=y,Dt = mt,t=l,...,to-l) = 



= ^^^*0 = a;. Dt„ = mt„ \Xt^-i = y) 

yes 

■ P{Xt,,-i = y\Dt = mt,t=l,...,to-l)P{Dt = mt, t = 1, . . . ,to - 1) 

to — 1 

= ^P{Xto = x,Dt„ = mta\Xt„-i = y)n{y) P{Dt = mt). 
yes t=i 



Here we used in the Markov Property of X and in the induction step. 
Because -P(A = rnt) = ba{m{t)), the proof will be done if we can 

show 



'^P{Xt^ = x,Dtg = mtjXt,,-! = y)TT{y) = Tr{x)ba{mtJ. (5.40) 

yes 

We have two cases: 

(a) X does not show a fresh customer. Then the predecessors y G i = 

1, . . . ,C{n + 1), ol X which lead by a one-step transition including a departure 
of a customer of type m to a; are described before (5.9) in the proof of theorem 
5.3. The LHS of (5.40) is therefore 



C(n+l 



E E 




ba{m) \ 
cC{n+l)J 



cd (y,x). 




100 



Chapter 5. Networks with Doubly Stochastic and Geometrical Servers 



(b) X shows exactly one fresh customer located in position i £ {1, . . . , C{n)}. 
Then the predecessors y G = l,...,C(n+ 1), of x which lead by 

a one-step transition including a departure of a customer of type m to x are 
described before (5.15) in the proof of theorem 5.3. The LHS of (5.40) in this 
case is therefore (for i fixed) 



G 



Theorem 5.29 Consider a sequence of doubly stochastic nodes according to de- 
finitions 5.1, 5.2, and 5.5. Assume the capacity functions C'(.) of the nodes are 
C(.)(n) = l,n > 1. The nodes are numbered 1 through J, customers arrive at 
node 1 and pass the nodes sequentially in this order, departing from the system 
after leaving node J . Node 1 is fed by a state independent Bernoulli-(b) arri- 
val stream of different customer types m £ M . The state process X = (Xt = 
(Xift); . . . ,Xj(t)) : t > 0) with state space S (as described before definition 5.11 
but without including the customers’ stage on their passage through the tandem) 
records the customer type sequences at the nodes and the associated residual 
amount of services requested for. Xj{t) is the local state of node j at time t, 
J = 1,...,J. 

X is positive recurrent if and only if each node in isolation fed by a state 
independent Bernoulli- (b) arrival stream of different customer types m £ M is 
positive recurrent. If this is the case then the steady state of X is 



.} 

= W_TTj{xj) , if x = {xi,. . . ,xj) £ S, (5.41) 

where for j = 1, ..., J with the notation of (5.27) in corollary 5.1) 

TTj^ej) = c~^Aj^, and (5.42) 



TTj{[m{j, nj),k{j, Uj);...] m{j, 1)]) 

= [fj 



(5.43) 



Proof : The proof is by induction using theorem 5.28. We assume that X is star- 
ted with initial distribution = tt, therefore having independent coordinates 
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at time 0. For jq > 1 we have 



P{^j{t) =Xj .3 = l,...,jo) 


Xj G Sj , J 1 , . . . , Jo 


(5.44) 


II 

M 

M 


•• E 




mip-iG(MU{0})* mju_2G(MU{0})* 


miG(MU{0})* 




Pi^jit) =Xj :j = l,.. . , jo, (£>i(l), . . . , Dj{t)) = mjJ = 1, . 


••,jo- 1) 


= E E ^ 


•• E 




mio_iG(MU{0})‘ mjj,_2G(MU{0})* 


miG(MU{0})* 





^ Djo-iW) = ’m-jo-i) 
P{^jo-i{^) ~ (-^io-l(l)j . . . 

• • • > Dj„-l{t)) = Wjo-l)|(i:>jo-2(l), ■ • ■ , £>jo-2 W) = Wjo- 2 ) 



• P{^ 2 {t) = X2,{D2{1), . . . ,D 2 {t)) = m 2 )\{Di{l), . . . ,Di{t)) = mi) 

• P{Xi{t)=xi,{Di{l),...,Di{t))=nh) 

In we used successively that due to the single server property Cj (ji) = 1 , n > 
0, and due to the linear structure of the system {Xj (t) = Xj , {Dj{l) ,... ,Dj{t)) = 
ffij) is independent of {Xi{t) = Xi : i = 1, . . . , j — 2, , Di{t)) = rhi, i = 

given (£»j_i(l), . . . , Dj_i(f)) = m^-i) andXj(O). 

Applying theorem 5.28 to (5.44) yields 

P{Xj{t) =Xj : j = l,...,jo) 

E E - E 

mig_iG(MU{0})* m:jp_2G(MU{0})* miG(MU{0})* 

P{^j{t) =Xj :j = 1,.. .,jo, {Dj{0), ..., Dj{t)) = WijJ = 1, . . . , jo - 1) 

E E - E 

rnig_iG(MU{0})‘ rfiig _ 2 G (MU{0})‘ rft2G(MU{0})‘ 

P{Xj^{t) =Xj„\{Dj„_i{fl),...,Dj„_i{t)) =mjo_i) 

• P{Xj^-i(t) = Xj„-i, (£>jo_i(0), . . . 

• • • = Wjo-i) I (£>10-2(0),. . . ,£>io_2(t)) = rrij^- 2 ) 

■ P{X2{t) = X2, (D2(0), ..., D2(t)) = ffl2))P{X^{t) = Xi) 

Applying now the induction hypthesis we obtain the independence of (Xj(t) : 

j = l,...,jo). G 

Note that the result and the proof of theorem 5.12 do not apply to the situa- 
tion and framework of theorem 5.29 because we did not impose the restriction 
(3) of definition 5.11 on multiple events originating in joint events from different 
nodes. Multiple events due to a departure at some different nodes, combined 
with an arrival there are allowed, because there is at most one departure at 
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every time instant at a single node. So only (D) of definition 5.2 applies and 
there are no multiple departure candidates at each node. 



Corollary 5.30 Consider a sequence of single server queues in discrete time 
with a state independent Bernoulli- (b) arrival stream of customers with diffe- 
rent customer types. The service requests of the customers may he node and type 
dependent and constitute an independent family of random variables which is 
independent of the arrival decisions. An arriving customer is of type m € M 
with probability a{m) and requests at node j for kj quanta of service time with 
probability pj^m{kj),kj > 1. 

If the service regime of the nodes is ezt/ier Last-Come-First-Served-Preemptive- 
Resume or Random Service Allocation or Round-Robin-Premptive-Resume 
(for details see [32]) then in equilibrium the nodes behave as if they are in- 
dependent. The steady state distribution is given by 



Tr{[m{j,nj),k{j,nj);...;m{j,l),k{j,l)] = (5.45) 

J 

n 

i=i 



c ^Y[ a{m{j,i)) Pi 



-1 

j 



h-i =ki 



The steady state joint queue length distribution is insensitive with respect to the 
shape of the service time distribution as long as their means are not perturbed. 



Corollary 5.31 Consider a sequence of doubly stochastic queues according to 
definitions 5.1, 5.2, and 5.5 in discrete time with a state independent Bernoulli- 
(h) arrival stream of customers with different customer types. For each node 
internal concurrent departure requests of departure candidates at this node are 
regulated according to repetitive service/rejection blocking with restarting the jobs 
of the departure candidates according to definition 5.1, part (3). Exception: when 
there is an additional arrival at this node one departure candidate is selected at 
random to depart immediately, substituted in his position by the arriving custo- 
mer. Single departures realised at the same time epoch at different nodes are 
admitted. 

The service requests of the customers may be node and type dependent and con- 
stitute an independent family of random variables which is independent of the 
arrival decisions. The state process X is positive recurrent if and only if each 
node in isolation fed by a state independent Bernoulli-(b) arrival stream of dif- 
ferent customer types m £ M is positive recurrent. If this is the case then the 
steady state of X is of product form and given by (5.41). 

The proof of corollary 5.31 is similar to that of theorem 5.29. For the case of 
having only one customer class, (i.e., indistinguishable customers with identical 
stochastic behaviour traverse the tandem,) there is another way to prove the 
theorems and corollaries of this section. For this we notice that the results in 
theorem 5.28 imply that the doubly stochastic queue in isolation is quasi rever- 
sible in the sense of definition 12.6 in [18], which can be concluded from lemma 
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12.8 there. As a consequence for the case of indistinguishable customers traver- 
sing the linear tandem, theorem 12.15 in [18] yields the results of theorem 5.40 
and corollary 5.42 for that case. 

It should be noticed that some care is needed in applying the quasi reversibility 
theorems from [18]. This originates from the different regulation schemes for the 
arrival and departure events which are prescribed, see figures 2.2 and 2.3. The 
definition of quasi reversibility requires that the state of the node is observed at 
epochs between the possible departure and arrival in [t,t+l), p. 350 in [18]. Ne- 
vertheless the qualitative characterization of quasi reversibility via lemma 12.8 
in [18] meets the properties obtained in the output theorem 5.28. Another way 
to resolve the problem is to reconsider the pathwise construction of the state 
process for the single nodes in corollary 2.2. 

It should be further remarked that connecting these nodes to a tandem and 
then comparing the models and applying the proved theorems vice versa possi- 
bly may result in slight problems: In the framework of [18] the customers depart 
from a node at the beginning of a time slot (i.e., at time t+) and arrive at the 
next station at the end of the same time slot [t,t + 1) (i.e., at {t + 1))—). So 
transition needs a unit of time, while in our models transition is assumed to be 
immediate. It follows that although the state processes observed at slot bound- 
aries are stochastically indistinguishable, care is needed in drawing conclusions 
about derived performance measures, e.g. on mean passage times via Little’s 
formula. 




Chapter 6 



General Networks with 
Batch Movements 
and Batch Services 



The structural and computational simplicity of classical product form queu- 
eing networks in continuous time (see e.g.: [75], [4], [69], [50]) relies on the pro- 
perty that independently moving customers which are independently served with 
probability one do not jump at the same time instant. From about 1990 on a 
sequence of papers appeared which considered explicitly networks where servi- 
cing is done for customer batches and where customers are forwarded into and 
through the network in batches. Before that, similar problems were mostly dealt 
with via simulation or using approximations. Only special mini networks were 
solved explicitly. 

Now there is a formalism and computational approach to solve classes of 
queueing models where explicit steady-state probabilities can be given although 
batch movements and batch services are allowed, a review on the state of the 
art can be found in [18] and [121]. 

In discrete time networks, phenomena like batch processing and travelling in 
batches are natural features of the systems, as discussed in chapter 4. Fortunately 
enough with respect to discrete time networks, most of the underlying principles 
developed for continuous time batch movements networks carry over directly. In 
most of the papers to be mentioned below the results were therefore derived for 
both cases simultaneously. The different interpretations of the formulas - which 
indeed are necessary for correctly applying them - have to be done carefully. 
(See Remark 6.8.) 

Reviewing the literature we see that a great number of different, but related 
models were developed. Indeed, some inventions were done in parallel, but often 
the explicit notation differs considerably. In the book of Chao, Miyazawa, and 
Pinedo [18] a considerable part of general network models are described. The 
book mainly deals with continuous time systems, but the formalism is versatile 

H. Daduna: Queueing Networks with Discrete Time Scale, LNCS 2046, pp. 105-120, 2001. 
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enough to carry over to discrete time scale, chapter 12 of the book is devoted to 
that. 

Naturally, this chapter has some overlap with the contents of chapter 12 of 
[18], because some of the underlying references coincide, but on the other hand 
there are sufficient many differences, originating in different points of view on 
the field. The aim of this chapter is, to compare the systems of chapters 2 to 5 
with the general batch movement sytems from the literature. 

Sections 6.1 and 6.4 describe a rather general model and its steady state 
behaviour, in section 6.5 we discuss special examples, in section 6.5 the networks 
introduced by Walrand [135], and finally we sketch additional triggering for 
special events in the general network. 



6.1 The General Network Model 

The central point of this section will be a short desription and discussion of a 
model which in my opinion is an appealing representative of what is going on 
in the field. The presentation follows Henderson and Taylor [56], [58], Miyazawa 
[98], [99], and Ozawa [104]. A recent discussion of structural properties of these 
models can be found in [23] . (This paper contains references for further applica- 
tions of the models, e.g., to Petri nets.) Partially parallel developments including 
some additional features in the networks as, e.g., state dependent routing are 
presented by Boucherie and van Dijk [8], [6]. 

The general formalism is rather abstract and therefore widely applicable. I 
shall then describe a sequence of prototype models, from the literature in some 
detail. This shows that it is often not an easy task to fit a concrete example into 
the formalism. Some related models procedures for special applications may be 
found in Woodward’s book [142]. 

We consider an open network of queues with nodes numbered 1, 2, . . . , J. 
Customers enter the system from the outside (which we usually consider as 
node 0), precede according to some routing regime through the network and 
eventually leave the system. The customers may be of different types which they 
may randomly change when entering a new node. The set M of customer types 
is assumed to be finite. 

The system evolves in discrete time IV according to some Markovian transi- 
tion law. We denote the state process of the system by A = (Xt : t £ IV), living 
on the state space S which is or a subset thereof. 

X carries the following detailed information: X=(Xf : t £ W) = ((Xt(j, m) : 
j = I, . . . , J,m £ M) : t £ IV), where Xt(j, m) = n{j, m) indicates that at time 
t there are n{j,m) customers of type m present at node j. 

The development of X is governed by sequences of release vectors D = (Dt : 
t £ IV) and transformed vectors A = {At : t £ IV). For t £ IV we have release 
vector 



Dt = {Dt{0),Dt{j,m), 1 < j < J,m £ M) 
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and transformed vector 



At = {At{0),At{j,m), I < j < J,m e M). 



Their functioning and interplay is as follows: 

Assume at time t G IN the network to be in state Xt = n. Then at time 
{t + 1)— from the source (node 0) T>t(0) = a(0) customers are released for 
being transformed into the network. From node j there are Dt{j,m) = a{j,m) 
customers of type m released to be transformed to some other node or to the 
sink (node 0). Immediately thereafter {between time {t+ 1)— and time t + 1) the 
released customers are transformed - possibly changing their types - to their 
destination nodes: At(0) = a'(0) customers depart from the network, At{j,m) = 
a'{j,m) customers of type m enter node j, 1 < j < J,m G M. Updating the 
state of the network according to this movements and changes we obtain Xt+\. 
Formally: For 

a = (a(0), a{j, m), 1 < j < J, m G M) 



let 



o'*" = (a(j, m), 1 < J < J, m G M) , 

and similarly let and be obtained from At and Dt by deleting the external 
components Ai(0) and Dt{0). Then 



Nt+i — Xt — + Af , t G IN, 



( 6 . 1 ) 



and 



At > D+, and Xt+i > A+ , (6.2) 

where the inequalities here and in the following are to be read coordinatewise. 
Having now 

Xt+i = n , Xt = n,Dt = a, At = a' then n = n — a~^ + a'~^ . 

Because new customers arrive only from the outside and vanishing customers 
must depart to the sink (node 0) we have the balance equation 



,7 ,7 

A(0) + ^ Dt{j,m) = At{0) + Y Y ^t{j,m). (6.3) 

j = l m£M j — 1 m£M 

The sequences A and D therefore assume only values from a commom state 
space which we denote by AG IN x . It should be noticed that the images 

of A and D nevertheless need not be identical. 

The following probabilistic assumption on A and D imply that X as given 
by (6.1) is a Markov chain with stationary transition probabilities: 

For t G IN Dt depends on the history of the system up to time t only through 
Xt and 

P{Dt = a\Xt = n,Xs = ns, Dg=as,As = a(,, 0 < s < t) (6.4) 
= P{Dt = a\Xt = n) = q{n,a), nGS,aGA, with (6.2), 
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At depends on the history of the system up to time (t + 1)— only through 
Dt and 



P{At = a'\Dt = aXs = Us,Ds = as,Ag = a'^,0 < s < t) (6.5) 

= P{At = a'\Dt = a) = r{a,a'), a,a'GA, with (6.3). 

The sequence of transformations of released vectors into transformed vectors 
governed by (6.5) shall be called routing process. The transition probabilities of 
X are 



P{Xf+i = n'\Xt = n) = q{n,a)r{a,a'), n,n' € S. 

a,a'€A 

„_a++a' + =n' 

From (6.3) it follows that a Markov chain on A determined by the transition 
matrix R = (r(a,a') : a,a' G A) (the routing matrix) is not irreducible. Vectors 
a and a' connected by (6.3) are assumed to be reachable vice versa via R. We 
assume 

Assumption 6.1 For the transition matrix R = {r{a, a') : a, a' G A) on A 
denote by Ak C A the set of those states in A which contain exactly k customers, 
k G IN. The sets Ak are finite and we assume henceforth that R restricted to 
each Ak is irreducible. 

6.2 Steady States 

The essential prerequisits for the successful steady-state analysis are the follo- 
wing assumptions. These assumptions or similar ones can be found in almost all 
papers on the subject which we consider here. 

Assumption 6.2 There exists a strict positive function : S — > (0,oo), 
and non negative functions 'll : S' x A — > [0, oo), and 0 : A — > [0, oo), 
such that for all n G S and all k G M the partial functions 

^{n,-):Ak — 1 [0,oo) (6.6) 

a — >■ 'I'(n, a) 



are constants, and 



q{n,a) 



'I'(n — a+, a) ■ 0(a) 
<I>(n) 



n G S, a G A. 



(6.7) 



Assumption 6.3 There exists strict positive functions f : A — > (0, oo), and 
g : S — > (0, oo), such that f solves the following traffic equations for batch 
movement systems 

0(a)/(a) = X! «)> a G A, 

a'eA 



( 6 . 8 ) 
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and there is a representation 

— x~ = Vn€S,a,a'€A with q{n,a)r{a,a') > 0. (6.9) 

g[n-a+ + a'^) f(a') 



Theorem 6.4 (Steady state) Suppose that assumptions 6.1, 6.2, 6.3 hold. 
Then the state process X of the network has an invariant measure it on S given 
by 



it(n') = ^(n)g(n), n € S. 



( 6 . 10 ) 



7T can he normalized to an invariant probability law ir of X on S if and only if 
C = V ^^6 case we have 



7r(n) = C ^^{n)g{n), n G S. 



( 6 . 11 ) 



Proof: Application of time reversing arguments according to proposition 7.2 of 
section 7.1 of the appendix (see [56] and [99]): 

We expect that the time reversal X of the state process X describes the evolution 
of a system with a similar structur as the original system. The release probability 
q{n, a) similar to (6.4) is the same as in the original system and given by (6.7) 
as well, while the routing probability r(-, •) similar to (6.5) is given by 

, 0(a)/(a)r(a, a') , 

9(l.-)/(<.-) 

According to proposition 7.2 of section 7.1 we have to prove for the non norma- 
lized measure tt and states n,n' G S 

q{n,a)r{a,a') = it{n') q{n' ,a')f{a' ,a). (6.12) 



a,a' 



, CL ^ .A 

'-a' + +a+=r, 



Inserting (6.10) and (6.7) into (6.12) and then applying (6.9) yields for the 
lefthand side of (6.12): 



d'(n - a+,a)0(a) , 

4>(n)g(n) ^ ^ r{a,a') 



(6.13) 



a,a' 

T, — a++a' + =n 



- a'^,a)Q{a)g{n - a+ + a'~‘~)jj^r(a, a'). 

a,a'€A ^ ' 

-a++a' + =n' 



The righthand side of (6.12) is 



d'(n'-a' ,a')0(a')-/ /^ 

Hn')g(n') ^ ^0 



G. , G ^ A. 
/_a' + +a+=„ 



' '+ ^ /N ©(«)/(«)’'(“> o') 

> , ^(n - a ,a )0(a )g[n)- 



G^ , G ^ .A 
/_a' + +a+=r, 



0(a')/(a') 



(6.14) 
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Now for each pair a, a' € A such that r(a, o') > 0 with n — a+ + a'~^ = n' 
the summands in (6.13) and (6.14) balance separately because 41(71 — a+,a) = 
41 (n' — a'^ , a'). The latter holds because n — a~^ = n' — a'~^ and a, a' are in the 
same class Ak (see assumption 6.2). Q 

For an explicit evaluation of tt according to (6.11) we need an explicit ex- 
pression for g{n),n € S, which is easier accessible than the representation given 
in (6.9) which in general is not easy to handle. 

For the case that in state n € S a, transition to n' = n — + a'^ is possible 

such that a+ — a'"*’ > 0 holds, (6.9) suggests a recursion step of the form 

g{n) = g{n - a+ + a'~^) ■ , (6.15) 

f[a') 

and provided this iteration can be continued we may hope to end eventually by 
g(ji), for some base state n, which in open networks usually can be chosen as 
n = 0, the empty network. Provided further, that this iteration for all states 
can be done in a well defined way, we would be able to compute the network’s 
equilibrium. 

The term well defined means that the result obtained by the iterative proce- 
dure does not depend on how the path from the base state h to any other state 
n is chosen in applying (6.15). 

As Miyazawa [98] noticed, almost all examples of open batch movement net- 
works which can be found in the literature, where an explicit product form 
equilibrium is known, show the following structure: The base state is the empty 
state of the network, n = 0. Let eg G A denote the unit vector having 1 in the 
0th coordinate and other coordinates 0, and G A the unit vector having 1 
in the (i, m)th coordinate and other coordinates 0. If q{n, eo)r(eo, Ci^m) > 0 then 
(6.9) and (6.15) imply 

9 [n + e^ J = g{n) ■ 

Denoting 



we obtain 

g{n) = g{0) n G S', 

j — l m^M 

/(a) = /(eo)n n oGA 

j—\ m^M 

For a discussion of the structural properties of functions obeying such a con- 
structive representation see [120], p.l49 and 155. Although the derivation there 
is done for continuous time systems the conclusions are relevant for our context 
as well. Note that Serfozo [120] discusses closed network applications as well. 



/(Si.m) 

/(eo) 






i = 1, 



I J, m G M, 
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Remark 6.5 In [56] and [98] (and the references given there) a stronger con- 
dition than assumption 6.2 is required. It is assumed that 'll : S' x ^ — > [0,oo), 
is a function of S only, independent of the second coordinate A. In [99] it was 
remarked that (6.6) suffices to prove the theorem. The interpretation is: 

For a,b € A we write b if and only if a, b are members of the same com- 
municating class with respect to the transition matrix R of the routing process. 
Then '!'(•,•) depends in its second coordinate only through the equivalence clas- 
ses with respect to So 'll can be written as (n,a) — > 'I'(n, a) := 'I'(n, a/ ^), 
where 



: S X {A/ — > [0, oo) 

is a function defined in its second coordinate on the equivalence classes of A 
modulo 

The introduction of the additional dependency of on a second coordinate 
with respect to A is assumed to broaden the applicability of the concept. 

Remark 6.6 In the definition (6.7) of the service allocation function q{-,-) the 
functions 'll, <i>, 9 cannot be chosen arbitrarily, because for any n the function 
q{n, •) is a counting density on A. <I>(n) is therefore the norming constant of 
q{n,-). In continuous time this restriction does not hold because q{-,-) is a rate 
then and normalization is not necessary. 

The form of q{-,-) allows a versatile modeling of service features. E.g., the 
total number of customers moving in one time step can be bounded by setting 
0(a) = 0 if a(0) + m) ^ ^ ® prescribed bound B. In 

example 6.11 this technique is used to obtain networks with single arrivals. 



6.3 Related Examples and 
Discussion of the Model 

In the literature a lot of companion models to that considered in section 6.1 can 
be found. Most of them describe systems which evolve in continuous time. Some 
representatives will be sketched in the following. Further models and references 
can be found in the references notes in [18] (section 12.9, p. 403). 

Remark 6.7 (Local balance and reversibility) Boucherie and van Dijk 
[7], [8] used a slightly different formalism to investigate queueing network models 
with batch movements, both in continuous and in discrete time. They introduced 
special local balance features observed in these networks to break the global ba- 
lance equations into subequations which results in product form structures of the 
solution. 

In [8] the result of Theorem 6.3 is generalized by incorporating state de- 
pendencies into the routing schemes of the customers. These dependencies are 
subject to an appropriate balancing behaviour. 
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Serfozo [120] developed a product form equilibrium formalism for queueing 
networks with concurrent (batch) movements in continuous time. The key pro- 
perty of the network processes (joint queue length vectors) is time reversibility. 
Applying the structural properties provided by Kolmogorov’s criteria this yields 
product form equilibrium. It turns out that there is a close connection to mult- 
idimensional birth-death-processes and to migration processes with concurrent 
migrations. 

The relevance of the continuous time network models to our discrete time fra- 
mework is at least twofold. We obtain two different approaches to discrete time 
modeling. These provide us with a simple machinery to produce discrete time 
stochastic networks from the more familiar continuous time counterparts by sim- 
ply reinterpreting the models’ description and data. 

First we may consider the embedded jump chain of the continuous time net- 
work process. This is a discrete time Markov chain describing a batch movements 
process where time durations are not taken into consideration. Substituting the 
exponential clocks by a synchronized clock with unit time steps we obtain a 
generic discrete time queueing network with batch movements of the customers. 

Second, assuming that the transition rates of the networks are bounded, we 
may apply a uniformization procedure to the network process. (See [73], chapter 
2.) This yields a continuous time Markov process which is stochastically indistin- 
guishable from the original process. The times between jumps are governed by 
a homogeneous Poison process with dummy jumps inserted, where the network 
jumps without time lag out of and into the same state. Considering the em- 
bedded jump chain (including the dummy jumps) yields a discrete time Markov 
chain with batch customer movements showing the same steady state as the ori- 
ginal continuous time process. Here the interpretation is that the homogeneous 
Poisson clock is substituted by a synchronized clock with unit time steps. 

Remark 6.8 (Scheduling of customers in the nodes) The state process un- 
der consideration only counts for the number of customers of different classes 
present at the nodes. Queueing due to an internal queueing discipline of the 
nodes can not be dealt with in general. Therefore the following physical interpre- 
tation of the internal node behaviour might be helpful for applying the abstract 
formalism in a modeling process: 

The nodes operate as infinite server queues with deterministic service time re- 
quests of one time unit for the customers. The service allocation is state- dependent 
according to q{-,-), see (6. 4). 

Reconsidering the generalized form (6.7) ofq{-, •), this interpretation confirms 
the statement of Remark 6.5: Without the introduction of the second coordinate 
of in (6.6) the dependence of the service allocation function q{n,a) on the 
released batch a and the stay-on customer vector n — o’*" would be of product 
form. This restrictive assumption is weakend by assuming (6.6). 

Taking into account explicit queueing behaviour by considering customer po- 
sitions is possible but needs restricted assumptions on how newly arriving cu- 
stomers are inserted into the queues. For the case of (similarly defined) closed 
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networks of queues in [60] it is assumed that the queues are organized according 
to the shift-protocol (see the description in Section 5.1) and that newly arriving 
customers choose their position at random from the feasible positions. This is 
the same arrival regime as described in (2) of definition 5.1 of Section 5.1 for 
doubly stochastic nodes. 

If all customers in the network are of the same type we can assume that any 
service discipline is applied for selecting those customers who obtain the service 
capacity which is provided to the node according to q{-,-). Especially we may 
assume that service is provided according to FCFS (first-come-first-served j as 
we have done in chapter 3 and ). 



Remark 6.9 (Closed networks) We have described the network up to now 
as an open system where customers enter from the outside, travel through the 
system and eventually leave the system. It is easy to carry over the development 
to the case of closed networks. We fix a constant number K of customers cycling 
in the network of nodes 1, . . . , J and changing their types according to q{-, •) and 
r{-,-), where the zero-coordinate is omitted. The release vectors then are of the 
form Dt = < j < J,m € M), and transformed vectors are of the 

form At = {At{j, rn) , 1 < j < J, m € M). For details see [60]. 

Some examples will now be discussed which are of special interest for applicati- 
ons. From a historical point of view they can be considered as landmarks on the 
way of developing discrete time stochastic network theory. We show examples 
for network nodes with internal queueing structure as well as for nodes without 
such specification. 



Example 6.10 (Networks with independent routing of customers) 

(See [56] and for the closed network case [60].) This is a network with the stan- 
dard routing process used in the most applications up to now. Independent Mar- 
kovian routing governs the customers’ movements in the classical continuous 
time networks of Jackson [69] and Gordon and Newell [50], and in the BCMP- 
networks (]4[. 

The routing process is as follows: A customer of type m departing from node 
i jumps to node j and changes to type m' with probability p{i,m;j,m'), inde- 
pendent of anything else in the network. This routing neither depends on the 
composition of the rest of the release vector nor on the composition of the rest 
of the transformed vector. For j = 0 this is the probability that a customer of 
type m on leaving node j departs from the network as a customer of type m' . 
By p{0;i,m) we denote the probability that a customer from the outside enters 
the network as a type m customer joining node i. This shall happen independent 
from the history of the network. 

The routing process defined by p on Ak, can be interpreted as a migra- 
tion process for k individuals on a set of J ■ \M\ -\- 1 nodes, k € IN. Con- 
sidering only one single customer on that network his steady state behaviour 
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y = (y{0),y{j,m) '■ 1 < j < J,m & M) will be determined by the traffic equation 

,7 

y{i,m) = y{0)p{0;i,m) + EE y{j,m')p{j,m';i,m), (6.16) 

j — 1 m'£M 

1 < i < J, m G M. 



Under our overall assumption 6.1 of irreducibility for the routing process on the 
components Ak an invariant measure for the routing process (taking into account 
all the possible permutations of the independently travelling customers) is 



x(a) 



a(0)! a{j,m)\ 



a&A 



We assume in this example the release probability q{n, a) to be inversely propor- 
tional to a(0)! and a{i,m)lA < i < J,m G M. This is granted e.g. by taking 
with C > 0 



0(a) 



C 

a(0)!ni=irimeMaO)"i)!’ 



aG A. 



(6.17) 



It turns out that for any network having the form (6.17) for 0 and having inde- 
pendent routing, suitable functions /, g are 



j 

/(«) = n n 

j — 1 mGM 
J 

g{n) = n n 

j — 1 mGM 

Thus from theorem 6.) we conclude that if the network can be stabilized then its 
steady state probability is given as 



,7 

n{n) = C<I>{n) J] H ^ ^ 

j — 1 m^M 

where <!>(•) is the norming constant for the release probabilities. 

Example 6.11 (Open tandem systems with geometrically distributed 
batches moving) Harnpanichpun and Pujolle [5)] applied the result of Hender- 
son and Taylor (see Theorem 6.)) to sequentially ordered nodes where 

indistinguishable customers enter the network at node 1, proceed to node 2, ... , 
and eventually depart from the network via node J. The regulation of the mo- 
vements is assumed to be of the form as desribed above: departures just before 
arrivals, and arrivals being late at times t—,t G IN . The network’s state, recor- 
ding the joint queue length vector Xt is observed at times t,t G TV. 
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The external arrivals occur at node 1 only: at each time instant there will ar- 
rive a batch of k customers with probability (1 — A)A^, k € M, for some A G (0, 1). 
The sequence of batch sizes is assumed to be i.i.d. and to be independent from 
anything else. The departure probabilities are node specific and depend on the 
history of the system only through the actual state of the node under considera- 
tion: 

If at node j there are Uj customers present at time t then with probability 
/i^/(l + /Xj + /i| + • • • + at time {t + 1)— a batch of size k will leave that 
node, {pj G (0, 1)), for all nodes j = 1, . . . ,J. 

The Markovian joint queue length process X = (Xt : t G IN) is ergodic if and 
only if X < pj, j = 1, ..., J . The steady state distribution is 

7r(m, ...,nj) 

= d-A)^nj(i-A)(A) + + + + 

Uj G IN,j = 1,..., J. 

(For the details of how to apply the formalism of Theorem 6. 4 see [54].) 

The linear structure of the network seems to be essential for the result de- 
scribed here. For a discussion and some counterexamples on nonlinear networks 
with truncated geometrically distributed batch service see [59]. 



In both examples 6.10 and 6.11 the internal service regime of the nodes is on a 
batch size basis: In example 6.10 according to (6.17) we have (nearly) truncated 
Poisson distributed batches released, while in example 6.11 the released batches 
are truncated geometrically distributed. 

The next example contributes to the discussion of batch movement by re- 
considering individual queues with single customer arrivals and services. The 
batch movements nevertheless occur from the synchronized network behaviour 
due to the discrete time scale. This is a subclass of the models in chapter 4. We 
demonstrate here how this subclass fits into the formalism of section 6.1. 



Example 6.12 (Open tandems of state dependent Bernoulli servers) 

Hsu and Burke [65] considered an open tandem of nodes 1, . . . , J where a Ber- 
noulli process with arrival probability b G (0, 1) feeds node 1 with a stream of 
undistinguishable customers who proceed stepwise through the sequence of nodes. 
The service probabilities are node specific and depend on the history of the system 
only through the actual queue length at the respective nodes. 

If at time t G IN there are Uj > 0 customers present at node j than there 
is with probability Pj{nj) exactly one depature from j at time (t -\- 1) — , with 
probability l—pj{nj) all customers stay at node j for at least one more time unit, 
Pj(0) = 0. If the system is ergodic its unique steady state is (see theorem 4-1) 



7r(m , . . . ,nj) = C\\_ 
j=i 



^ b{l-p,{h-l)) \ 

n {l-b)p,{h) j 



, Uj G N,j = 1,...,J. 
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As Henderson and Taylor (see Section 3-4 in [56]) noticed, this can he proved 
by an application of Theorem 6.]- They define for n = (ni, . . . ,nj) G IN'^ and 
a = {ao,ai, . . . ,aj) G IV 

if maxo<j<j(aj) G {0, 1} 
otherwise ’ 



0(a) = 



_ 5)(l-ao) 

0 



- a+) = i (1 - pjiuj - Qj)) 

i=i I h=i 



1-Pj{h-1 )' 
Pj{h) 



‘I’W = n n 

1=1 h=l 



1-Pj{h- 1) 

Pj{h) 



and obtain for n, a as above 

J 

q{n,a) = 6“°(1 - J] {(1 ~ } . 

1=1 

The functions /, g defined for n, a as above are 



/(a) 




ff(n) = 






niH hnj 



A property which is common to the systems of examples 6.11 and 6.12 is that the 
external arrivals are governed by batch Bernoulli processes ([18], definition 12.5). 
These are simply IN valued sequences of identically distributed independent 
random variables Z = (Zt : t G IV), where Zt denotes the number of arrivals 
in [t,t + 1). Zt is assumed to be independent of the history of the system up 
to and including t. In example 6.11 the Zt are geometrically distributed on IV 
with parameter 1 — A, in example 6.12 Zt is Bernoulli)^) distributed on {0, 1}. A 
further example will be provided by Walrand’s S-queue to be presented in the 
next section, where Zt is Poisson(A) distributed. In all cases it can be proved 
that in connection with the selected service regime the nodes transform the 
batch Bernoulli arrival stream into a batch Bernoulli departure stream with 
the same stochastic behaviour. Moreover all of these nodes are quasi reversible 
according to definition 12.6 in ([18]. It follows that these systems can be coupled 
to a linear tandem system with product form steady state. Further examples for 
similar procedures are given in corollaries 5.30 and 5.31, compare the discussion 
below corollary 5.31. 

Example 6.13 A class of systems different from those dealt with in examples 
6.13 - 6.12 are stochastic Petri nets with product form equilibrium. A direct 
application of theorem 6.) to solve a Petri net model can he found in [57]. For 
further relevant literature see the references in ]55]. 
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6.4 Walrand’s S— Queues and Networks 

Walrand introduced a network of so-called S-queues in discrete time and pro- 
ved that with an arrival sequence of independent Poisson-distributed customer 
batches and with a specific release probability the isolated nodes are quasi- 
reversible [135]. From this observation it follows that these nodes can be used as 
building blocks of networks with a product form equilibrium. For more detailed 
investigation of S-queues see [142] and [18]. For a single node Walrand’s result 
is: 

Theorem 6.14 Let A = {At : t € IN) be an IN-valued i.i.d. arrival sequence 
of Poisson-X variables (the transformed variables) and D = (Dt : t G IN) an 
M -valued sequence of release variables (to the outside). With a suitable initial 
value Xq the sequence 



Xt+i — Xt — Dt + At, t G IN, 

defines an S-queue if for 0 < u < v 

P{Dt = s < t; Ds, s <t-,As,s> 0, Xt + At = v) = S{v, u), 

holds for all t G IN. If for all v > 0 

S{v,0)=c{v), and for m>0 
c(v) 

S{v, u) = — /-a(v)a(v — 1) • • • a(v — u + 1), 0 < u < v, 

u\ 

where a(0) = 1 and a{u) > 0 for u > 0, and c(v) is such that S{v,-) is a 
density on {0, 1, . . . , v}, then the queue length process X = {Xt : t G IN) has an 
invariant measure 



7t{v) 



A’’ 

a(0) • • • a{v) ’ 



u > 0. 



If the invariant measure it can be normalized to an invariant probability law tt, 
then in steady state the departure sequence D = {Dt : t G IN) is an i.i.d. sequence 
of Poisson-X variables. Further for any t € IN {Ds : s < t — 1) is independent 
of Xt. (This is the quasi-reversibility for the S-queue.) 



Note that the time indices are partially shifted in the model of theorem 6.14 
compared to that from that used in [135] to fit it formally into the framework 
of Section 6.1. 

For using quasi-reversibility to prove product form equilibria for networks 
built from S-queues it turned out that the network has to be observed at time 
instances when customers are released from the nodes and from the outside but 
are not yet deposited at the destination nodes, see lemma 12.8 in [18]. Nevert- 
heless, as Henderson and Taylor remarked (see [56], Sect. 3. 3), these networks fit 
into the formalism described in Section 6.1. 
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In fact, these networks with only one customer class are closely related to 
example 6.10. This is because Walrand assumed independent Poisson-yj arrival 
sequences, j = 1, . . . , J, (7 = X)/=i 7j )> Markovian routing, and because the fun- 
ctions S(-, •) can be suitably reproduced. Taking Walrand’s routing probabilities 
(p{i,j) ■ 1 < i,j < J) and additionally {p{0,j) = 7 j /7 : 1 < j < J) we define 

J rii 

i—l h—1 

J rii — ai 

111(71 — o'*") = H H n € S,a € A,n — a > 0, 

i—l h—1 



7 a(0) 

0(a) = . 



a€A, 



and obtain for a stable system an equilibrium probability 

J 

Tt{n) = n G S, 



(6.18) 



where C is the normalizing constant and (y{j) : 1 < j < J) is the solution of 
the traffic equation similar to (6.16). 

The steady state probabilities (6.18) are obtained by Henderson and Taylor 
([56]) and differ from that obtained by Walrand. This is due to the fact that the 
systems are observed at different time points. 



Remark 6.15 (General network topology) While in examples 6.11 and 6.12 
quasi reversibility allows to couple nodes to linear tandems, the discussion above 
shows that S-queues can be used to build up networks with general topology, resp. 
graph structure. The reason for this is that independent splitting and merging of 
Poisson variables by the Markovian routing process yields Poisson variables as 
the batch sizes at other subsequent nodes as well. This is not the case for the 
batch size distributions in the other systems. 

Walrand’s networks of S-queues appear as standard examples in the litera- 
ture concerning service systems with batch arrivals and batch services. See, e.g, 
[6], [7], and [8]. Special attention is paid to these networks in the books [142] 
and [18]. In [142] all networks considered are of this type. For more details and 
especially for an extensive list of applications we refer to this book. 



6.5 Networks with Triggered Batch Movements 

Our aim in this section is complement the previous discussion and to sketch 
further directions of recent reseach concerning more general batch movement 
networks by describing a specific example. 
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These networks are generalizations of those described in section 6.1. My descrip- 
tion follows Henderson, Northcote, and Taylor [55]. The concept is developed 
as a unification of the batch movements networks and the recently introduced 
networks where events (e.g. service completions or arrivals) may trigger other 
events to happen. This happens in a way, that by a triggering event (e.g.) a sud- 
den departure of specific customers may be enforced without those customers 
having obtained the full requested service time. A related concept is that of ne- 
gative customers, see [46] and [19]. For a discussion of further related models 
and for more references see in [18] the reference note 9.8. The book contains 
generalizations of the network described in section 6.1 in chapters 4 through 11 
there. A recent extension of this research was done by Serfozo and Yang [122] 
who extended the general model description considerably. Continuation of this 
in continuous time framework to general batch service disciplines is done by Pe- 
terson [108]. All these models provide us with discrete time queueing networks 
as well using the approaches sketched below remark 6.7. 

We consider an open network of queues with nodes 1,2, ...,J. Customers 
enter the system from the outside (node 0), precede according to some routing 
regime through the network and eventually leave the system. The customers 
are undistinguishable and the state description of the network records the joint 
queue length vectors. Different customer types which may randomly change can 
be incorporated, see [55] section 4. 

The joint queue length process is A = : j = 1, . . . , J) : t G IN), where 

^t(j) = tij indicates that at time t there are Uj customers present at node j. 
The construction of the network’s evolution guarantees that A is a Markov chain 
with state space . The one-step transitions and their conditional probabilities 
are as follows: 

If the state of the network at time t G IN is Xt = n = (ni, . . . ,nj), then 
with probability 



q{n,a) 



4'(n — a)Q{a) 

4)(n) 



a batch a = (ai, . . . , aj) of customers is served at nodes 1, . . . , J, respectively. 

With probability p{a, a', a'') the released batch a attempts to trigger a batch 
a' = {a'l, . . . ,a'j) (enforcing these customers to immediately finish their ser- 
vice) and to deposit a further batch a'' = (a", . . . ,a") to the respective nodes, 
p(a, o', a'^) = 1. (Here a, a', a'' € A have to be chosen assuring some 
feasibility condition to guarantee consistent transitions.) The external arrivals 
are included in the deposited batch a'' , the internal transitions are included in 
a, a' and a'', the external departures are due to either a or a'. Batch a' ac- 
cepts the triggering with probability dr (n — a — a')/4'(n — a) and rejects it with 
probability 1 — 4'(n — a — a')/4'(n — a). 

The state Aj+i of the network at time t 1 then is n — a — a' -I- a'^ if the 
triggering was accepted and n — a if it was rejected. 
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The traffic equations similarly defined to (6.8) take the form 

0(a)/(a) (6.19) 

aeA - { 0 }. 

The introduction of an additional function g similar to Section 6.1 and the 
required representation (6.9) is substituted here by an assumption on the form 
of an existing strict positive solution of (6.19). The main result is: 

Theorem 6.16 If the traffic equation (6.19) has a product solution 

/(a) = Il2^? >0 

i=i 

then X has an invariant measure 

7r(n) = <h(n)/(n), n € IN'' . 

Proof: A direct solution of the global balance equations can be found in [55]. 

Remark 6.17 The existence of a strict positive solution of (6.19) is a nontrivial 
problem. For a discussion see [55], ppl32-133. 



Example 6.18 An example of a telecommunication network where customers 
may trigger by their arrival additional resources is worked out in detail in [55], 
Section ). This network model is then solved using the result of Theorem 6.16 . 




Chapter 7 

Appendix 



In this appendix we collect for ease of reference some facts which are used in the 
preceding chapters. Some of these are standard, sometimes not explicitly stated 
in the literature, some are proved for special requirements in the present text, 
but their proof is not essential for understanding the main developments. 

7.1 Time Reversed Processes 

We collect some propositions which are concerned with the time reversal of ho- 
mogeneous stationary Markov chains. The proofs are similar to those of their 
continuous time analogues, which are well known. For more details see [75] and 
[73]. 

Let X = (X{t) : t £ Z),X(t) : {E,V{E)),t £ he a, homoge- 

meous ergodic Markov chain with countable state space E, transition probability 
matrix p. The stationary distribution of X is tt = (7r(a;) : x £ E). 

Proposition 7.1 (Time reversal) Let X be in equilibrium tt and denote by 
X = (X{t) : t G Zi) the time reversal of X defined pathwise by 

x{t^(jj') = X — t^Lofi t £ Zj to £ n. 

Then X is a homogeneous, stationary ergodic Markov chain with steady state 
distribution tt and transition probability matrix p given by 

p{x,y) = p{y,x)——, x,y£E. 

TT[X) 

Proposition 7.2 (Computing steady states by reversing time) If for the 

Markov chain X with transition matrix p and and equilibrium tt we can find 
a transition probability matrix p = {p{x, y) : x,y £ E) such that for some proba- 
bility measure it = (tt(x) : x £ E) 

tt{x)p{x, y) = it{y)p{y, x), x,y £ E, 

H. Daduna: Queueing Networks with Discrete Time Scale, LNCS 2046, pp. 121-123, 2001. 

© Springer- Verlag Berlin Heidelberg 2001 
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holds, then tt = it is the unique steady state of X and X and p = p is the 
transtion probability matrix of X. 



7.2 Symmetric Functions 



Lemma 7.3 For integers K, J > 1, ft, G {0, 1, . . . , J}, and 
r(ft) := {A C {1, . . . ,J'\-.\A\= ft} we define the function 



r^K,j 



: r(ft) X 



R 



by 



{A; zi,...,zj)- 



E 



(®i 

xiH hxj=K' 





{A, Zi, . . . , zj) € r(ft) X R"', where rj{a, b) = 

is the complementary Kronecker delta. 

Then for fixed (zi, . . . , zj) G R"^ the function 



Jo a = b 
} 1 a b 



,zj) :r(ft) 



R,A 



^K,J 

'-'h 



{A-, 



zi, 



,Zj) 



is a constant. (For definitness we set 0 • ^ 0.} 

Proof: (a) For J = 2 and ft = 1 zi, Z 2 ) = Cf’’^({2}; zi, Z 2 ) can be 

verified by direct computations. 

(b) Suppose we have proved the statement for all J = 2, . . . , Jq — I, h < Jq — I, 
and all K. We shall prove the statement for Jq, ft < Jq, and all K by induction. 

Let Aq, A\ g r(fto) = {A C {1, . . . , Jg} :| A |= ftg}, Aq yf Ai, ig G Aq — 
Ai,ii G Ai- Ao, and zi, . . . , zj^ G R - {0}. 

Then 



^K,Jq 

^ho 



(-Aq, Zi , . . . , ZJq ) 



E -0 

xi +xii=k 



1 + — 
Z,;, 



r(o,oci,^) 



E 



n 



=IN,jG{i,... ,Jo>-{io.n> 



n 






1 + - 



rj(0,i 
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Here all substitutions are justified by the induction hypothesis. 0 

Corollary 7.4 For fixed K, J, h, A the function 

,zj)^C^'\A-zu... ,zj) 

is a symmetric function, i.e., interchanging the arguments Zj leaves the value of 
the function invariant. 
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